00000001:02000400:0.0F:1783137293.968068:0:2961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1783137309.367587:0:3183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1783137311.252549:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 595 MB/s 00000001:01000000:2.0F:1783137311.502651:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1195 MB/s 00000001:01000000:2.0:1783137311.751824:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10367 MB/s 00000020:02000000:1.0F:1783137312.241346:0:3275:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_85_gf55a92a 00000400:02000000:2.0:1783137312.949375:0:3290:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.136@tcp [8/256/0/180] 00008000:02000000:0.0:1783137316.605936:0:3440:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1783137369.184453:0:5269:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783137387.600276:0:5795:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783137387.600282:0:5795:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1783137387.600394:0:5795:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000317be024 00000080:02000400:2.0:1783137387.600404:0:5795:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1783137387.619215:0:5795:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1783137387.619228:0:5795:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783137387.619263:0:5795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001075fbc0) 00000020:00000080:2.0:1783137387.619282:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783137387.690237:0:5795:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783137387.691827:0:5795:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783137387.796593:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783137387.796720:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783137387.796742:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783137387.796829:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783137387.797044:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783137387.799681:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783137387.799691:0:5795:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783137387.799706:0:5795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac674625 00000020:01000004:2.0:1783137387.799714:0:5795:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783137387.799719:0:5795:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783137387.799724:0:5795:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000317be024 from MGS 00000020:01000004:2.0:1783137387.799728:0:5795:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783137387.799739:0:5795:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000fc8fea4f) 00000020:00000080:2.0:1783137387.799750:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783137387.799824:0:5795:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000317be024 from MGS, refs=2 00080000:01000000:2.0:1783137387.799830:0:5795:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783137387.799834:0:5795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac674633 00000100:00100000:3.0:1783137387.803002:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783137387.803153:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783137387.803171:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1783137387.805251:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1783137387.805265:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783137387.806148:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137387.806305:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783137387.806310:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783137387.807580:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783137387.807588:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783137387.808098:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783137387.808106:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783137387.809575:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137387.809579:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137387.809585:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137387.810009:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137387.810011:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137387.810013:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137387.813431:0:5795:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783137387.817279:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1783137388.064110:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3039 MB/s 00000001:01000000:3.0:1783137388.314530:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2555 MB/s 00000001:01000000:0.0:1783137388.567419:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 579 MB/s 00000001:01000000:0.0:1783137388.818286:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 840 MB/s 00080000:10000000:0.0:1783137388.829779:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1783137388.841664:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783137388.875545:0:5795:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1783137388.878729:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783137388.878737:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1783137388.892888:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783137388.893501:0:5795:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783137388.893578:0:5795:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1783137388.894097:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783137388.894123:0:5795:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783137388.894397:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137388.894531:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783137388.894537:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783137388.896335:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783137388.896345:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783137388.896719:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783137388.896726:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783137388.907340:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783137388.907362:0:5795:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.136@tcp' 00000020:01000004:3.0:1783137388.907363:0:5795:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783137388.907402:0:5795:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.136@tcp (typ=mgc) 00000020:00000080:3.0:1783137388.907434:0:5795:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.136@tcp (000000008796807a) 00000020:00000080:3.0:1783137388.907451:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783137388.907534:0:5795:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006968cd58@MGC192.168.203.136@tcp: add connection 192.168.203.136@tcp at head 00010000:00010000:3.0:1783137388.907715:0:5795:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.136@tcp-0 is initialized 00000040:01000000:3.0:1783137388.907720:0:5795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 1 is initialized 00000100:00080000:1.0:1783137388.908235:0:5810:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1783137388.917924:0:5811:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783137388.919269:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.136@tcp (uuid 73e4795b-54a4-4490-bb2a-864b21234c99) 00000020:00000080:3.0:1783137388.919290:0:5795:0:(genops.c:1406:class_connect()) connect: client 73e4795b-54a4-4490-bb2a-864b21234c99, cookie 0x88def104ac674641 00000100:00080000:3.0:1783137388.919301:0:5795:0:(import.c:512:import_select_connection()) MGC192.168.203.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783137388.919306:0:5795:0:(import.c:626:import_select_connection()) MGC192.168.203.136@tcp: import 000000006968cd58 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137388.919350:0:5795:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005775c4e1 x1869754990067840/t0(0) o250->MGC192.168.203.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783137388.919368:0:5795:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 73e4795b-54a4-4490-bb2a-864b21234c99->MGS 00000020:01000004:3.0:1783137388.919398:0:5795:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783137388.919403:0:5795:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783137388.919419:0:5795:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d1942d0c) 00000020:00000080:3.0:1783137388.919430:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1783137388.920015:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005775c4e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e4795b-54a4-4490-bb2a-864b21234c99:3305:1869754990067840:0@lo:250: 00000100:00100000:0.0:1783137388.920110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137388.920683:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990067840 00000100:00100000:2.0:1783137388.920691:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990067840 00000100:00100000:2.0:1783137388.920718:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137388.920724:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029a1b957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1869754990067840:12345-0@lo:250: 00010000:00080000:2.0:1783137388.920747:0:5807:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 73e4795b-54a4-4490-bb2a-864b21234c99@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:2.0:1783137388.920776:0:5807:0:(genops.c:1406:class_connect()) connect: client 73e4795b-54a4-4490-bb2a-864b21234c99, cookie 0x88def104ac67464f 00000100:00080000:2.0:1783137388.921179:0:5807:0:(import.c:65:import_set_state_nolock()) 000000003bc28fd8 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783137388.921248:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029a1b957 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+5:3305:x1869754990067840:12345-0@lo:250: Request processed in 522us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137388.921255:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137388.921730:0:3305:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1783137388.921739:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.136@tcp: connect to target with instance 0 00000100:00080000:0.0:1783137388.921746:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783137388.921750:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783137388.921753:0:3305:0:(import.c:65:import_set_state_nolock()) 000000006968cd58 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783137388.921755:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783137388.921763:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783137388.921768:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005775c4e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e4795b-54a4-4490-bb2a-864b21234c99:3305:1869754990067840:0@lo:250: 00000100:00100000:3.0:1783137388.943450:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137388.952990:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783137388.953002:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783137388.960345:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783137388.960359:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783137388.968394:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783137388.968405:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783137388.995472:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137388.995648:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783137388.995654:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783137388.999028:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783137388.999043:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783137389.105196:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137389.105981:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783137389.105989:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783137389.127203:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783137389.127285:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783137389.135532:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137389.136077:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783137389.136084:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783137389.138271:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137389.138287:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783137389.139939:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137389.140099:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783137389.140105:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783137389.143490:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137389.143509:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783137389.144362:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137389.144544:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783137389.144550:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783137389.147683:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137389.147696:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783137389.226036:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137389.228477:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783137389.228487:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783137389.231483:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783137389.231495:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783137389.234463:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783137389.234475:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1783137389.243414:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783137389.243590:0:5795:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1783137389.243598:0:5795:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783137389.243741:0:5795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783137389.243777:0:5795:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.136@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1783137389.243781:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783137389.243782:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783137389.243783:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137389.243784:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137389.243815:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137389.243816:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137389.243818:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783137389.243819:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783137389.243820:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137389.243821:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137389.243822:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137389.243823:0:5795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783137389.243825:0:5795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1783137389.243827:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783137389.243829:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783137389.243829:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137389.243830:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137389.243831:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137389.243832:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137389.243833:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783137389.243834:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783137389.243835:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137389.243835:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137389.243836:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137389.243837:0:5795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783137389.243869:0:5795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783137389.243885:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f87ada15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990067968:0@lo:253: 00000100:00100000:0.0:1783137389.243948:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137389.244002:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 00000000dcffdf6a going to sleep for 11 seconds 00000100:00100000:3.0:1783137389.244144:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990067968 00000100:00100000:3.0:1783137389.244150:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990067968 00000100:00100000:3.0:1783137389.244186:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137389.244194:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b940a320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+5:5795:x1869754990067968:12345-0@lo:253: 20000000:01000000:3.0:1783137389.244237:0:5809:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783137389.244239:0:5809:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1783137389.244820:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783137389.244876:0:5809:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1783137389.245122:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137389.246475:0:5831:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1783137389.255069:0:5809:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783137389.255076:0:5809:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1783137389.255082:0:5809:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1783137389.255084:0:5809:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1783137389.255098:0:5809:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1783137389.255323:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783137389.255538:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1783137389.255550:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783137389.255598:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1783137389.255664:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1783137389.255703:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1783137389.255785:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1783137389.255837:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1783137389.255893:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1783137389.255900:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1783137389.255928:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1783137389.255935:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1783137389.255969:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1783137389.256041:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1783137389.256071:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1783137389.256076:0:5809:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1783137389.256087:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783137389.256271:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1783137389.256280:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783137389.256313:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1783137389.256347:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1783137389.256394:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1783137389.256405:0:5809:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1783137389.256473:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1783137389.256482:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783137389.256527:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1783137389.256565:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1783137389.256599:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1783137389.256609:0:5809:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1783137389.256884:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1783137389.256893:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1783137389.256923:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1783137389.256956:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1783137389.257098:0:5809:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1783137389.257144:0:5809:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1783137389.257151:0:5809:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783137389.258974:0:5832:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1783137389.260971:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1783137389.261001:0:5809:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.136@tcp for mdt 20000000:01000000:0.0:1783137389.261004:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:0.0:1783137389.261060:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1783137389.261068:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783137389.261098:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1783137389.261106:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:0.0:1783137389.261160:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1783137389.261170:0:5809:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1783137389.261202:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1783137389.261237:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1783137389.261295:0:5809:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783137389.261298:0:5809:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783137389.261303:0:5809:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783137389.261309:0:5809:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1783137389.261821:0:5833:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1783137389.263289:0:5809:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783137389.279917:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1783137389.279968:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1783137389.280034:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1783137389.280053:0:5809:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783137389.280055:0:5809:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783137389.280059:0:5809:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783137389.280070:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783137389.280072:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783137389.280099:0:5809:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783137389.280101:0:5809:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783137389.281600:0:5834:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1783137389.281892:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1783137389.281936:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1783137389.282003:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1783137389.282016:0:5809:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783137389.282019:0:5809:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783137389.282514:0:5835:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1783137389.282722:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1783137389.282763:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1783137389.282831:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1783137389.282846:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783137389.282848:0:5809:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1783137389.282854:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783137389.282873:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282887:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282896:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282902:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282917:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282923:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282930:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005eaaafed already unused, calling callback (00000000beab0179) 00010000:00010000:2.0:1783137389.282933:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282940:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282951:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282959:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.282965:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005eaaafed/0x88def104ac674656 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783137389.282983:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783137389.832099:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b940a320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+5:5795:x1869754990067968:12345-0@lo:253: Request processed in 587899us (588144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137389.832118:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137389.832222:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f87ada15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990067968:0@lo:253: 10000000:01000000:2.0:1783137389.832235:0:5795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783137389.832238:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783137389.832239:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783137389.832241:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137389.832241:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783137389.832243:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137389.832265:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137389.832266:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783137389.832267:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783137389.832268:0:5795:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783137389.832270:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137389.832271:0:5795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783137389.832288:0:5795:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000317be024 from lustre-MDT0000 10000000:01000000:2.0:1783137389.832309:0:5795:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783137389.832312:0:5795:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783137389.832316:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9709873db380 10000000:01000000:2.0:1783137389.832320:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783137389.832328:0:5795:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9709873db380 from 1 10000000:01000000:2.0:1783137389.832331:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783137389.832393:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.832404:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.832659:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137389.832680:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000079fb2db3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068096:0@lo:101: 00000100:00100000:2.0:1783137389.832716:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137389.832779:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 000000006b3035db going to sleep for 11 seconds 00000100:00100000:0.0:1783137389.832917:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990068096 00000100:00100000:0.0:1783137389.832923:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990068096 00000100:00100000:0.0:1783137389.833029:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137389.833037:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bf1af02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+5:5795:x1869754990068096:12345-0@lo:101: 00010000:00010000:0.0:1783137389.833049:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137389.833062:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67465d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137389.833088:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67465d expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137389.833097:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67465d expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137389.833104:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bcd1cb69, rc 0) 00000100:00100000:0.0:1783137389.833226:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bf1af02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+6:5795:x1869754990068096:12345-0@lo:101: Request processed in 190us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137389.833232:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783137389.837138:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000079fb2db3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068096:0@lo:101: 00010000:00010000:1.0:1783137389.837166:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137389.837178:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137389.837481:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068224:0@lo:501: 00000100:00100000:1.0:1783137389.837536:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137389.837646:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 000000008d195eb7 going to sleep for 11 seconds 00000100:00100000:0.0:1783137389.840323:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990068224 00000100:00100000:0.0:1783137389.840334:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990068224 00000100:00100000:0.0:1783137389.840500:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137389.840510:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d6c5922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+6:5795:x1869754990068224:12345-0@lo:501: 00000100:00100000:0.0:1783137389.840823:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d6c5922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+6:5795:x1869754990068224:12345-0@lo:501: Request processed in 282us (3254us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783137389.840831:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783137389.840949:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068224:0@lo:501: 10000000:01000000:1.0:1783137389.840984:0:5795:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783137389.841003:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137389.841012:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137389.841020:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97099cc6e000 10000000:01000000:1.0:1783137389.841024:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783137389.841028:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97099cc6e000 10000000:01000000:1.0:1783137389.841030:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783137389.841033:0:5795:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff97099cc6e000 from 1 10000000:01000000:1.0:1783137389.841035:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783137389.841062:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 0000000045b34dd1/0x88def104ac67466b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137389.841068:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 0000000045b34dd1/0x88def104ac67466b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137389.841075:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 0000000045b34dd1/0x88def104ac67466b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137389.841090:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068352:0@lo:101: 00000100:00100000:1.0:1783137389.841131:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137389.848155:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 000000008d195eb7 going to sleep for 11 seconds 00000100:00100000:2.0:1783137389.851070:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990068352 00000100:00100000:2.0:1783137389.851081:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990068352 00000100:00100000:2.0:1783137389.851129:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137389.851136:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a76e4459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+6:5795:x1869754990068352:12345-0@lo:101: 00010000:00010000:2.0:1783137389.851153:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137389.851169:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000014fdccd8/0x88def104ac674672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67466b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.851210:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000014fdccd8/0x88def104ac674672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67466b expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.851219:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000014fdccd8/0x88def104ac674672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67466b expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.851227:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000014fdccd8, rc 0) 00000100:00100000:2.0:1783137389.852744:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a76e4459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+7:5795:x1869754990068352:12345-0@lo:101: Request processed in 1606us (11610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137389.852753:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783137389.856050:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068352:0@lo:101: 00010000:00010000:1.0:1783137389.856075:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 0000000045b34dd1/0x88def104ac67466b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137389.856086:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 0000000045b34dd1/0x88def104ac67466b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137389.856102:0:5795:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783137389.856165:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 0000000045b34dd1/0x88def104ac67466b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137389.856173:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 0000000045b34dd1/0x88def104ac67466b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137389.856181:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783137389.856187:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783137389.856192:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97099cc6e000 10000000:01000000:1.0:1783137389.856194:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783137389.856198:0:5795:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783137389.856200:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783137389.856226:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137389.856233:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137389.856240:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137389.856278:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068480:0@lo:101: 00000100:00100000:1.0:1783137389.856327:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137389.856390:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 000000008d195eb7 going to sleep for 11 seconds 00000100:00100000:2.0:1783137389.856489:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990068480 00000100:00100000:2.0:1783137389.856495:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990068480 00000100:00100000:2.0:1783137389.856532:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783137389.856539:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000163f3b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+7:5795:x1869754990068480:12345-0@lo:101: 00010000:00010000:2.0:1783137389.856550:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137389.856560:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674679 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.856576:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674679 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.856584:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674679 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137389.856592:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5dcd71d, rc 0) 00000100:00100000:2.0:1783137389.856636:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000163f3b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+8:5795:x1869754990068480:12345-0@lo:101: Request processed in 86us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137389.856642:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137389.857510:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068480:0@lo:101: 00010000:00010000:1.0:1783137389.857522:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137389.857529:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137389.857577:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068608:0@lo:501: 00000100:00100000:1.0:1783137389.857605:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137389.857647:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 000000008d195eb7 going to sleep for 11 seconds 00000100:00100000:2.0:1783137389.857700:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990068608 00000100:00100000:2.0:1783137389.857704:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990068608 00000100:00100000:2.0:1783137389.857738:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137389.857744:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fce7e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+8:5795:x1869754990068608:12345-0@lo:501: 00000100:00100000:2.0:1783137389.858022:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fce7e14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+9:5795:x1869754990068608:12345-0@lo:501: Request processed in 278us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137389.858028:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783137389.859046:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068608:0@lo:501: 00000100:00100000:1.0:1783137389.859078:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068736:0@lo:503: 00000100:00100000:1.0:1783137389.859125:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137389.859158:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 000000008d195eb7 going to sleep for 11 seconds 00000100:00100000:2.0:1783137389.859913:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990068736 00000100:00100000:2.0:1783137389.859919:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990068736 00000100:00100000:2.0:1783137389.860190:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137389.860199:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086d1a2e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+9:5795:x1869754990068736:12345-0@lo:503: 00000100:00100000:2.0:1783137389.861320:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086d1a2e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+9:5795:x1869754990068736:12345-0@lo:503: Request processed in 1123us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137389.861330:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783137389.861680:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990068736:0@lo:503: 00000100:00100000:3.0:1783137389.862129:0:5837:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000036acd005 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:5837:1869754990068864:0@lo:502: 00000100:00100000:3.0:1783137389.862176:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137389.862229:0:5837:0:(client.c:2701:ptlrpc_set_wait()) set 000000006071fe45 going to sleep for 11 seconds 00000100:00100000:1.0:1783137389.862267:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990068864 00000100:00100000:1.0:1783137389.862271:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990068864 00000100:00100000:1.0:1783137389.862344:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783137389.862351:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4bad669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+9:5837:x1869754990068864:12345-0@lo:502: 00000100:00100000:1.0:1783137389.862621:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4bad669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+9:5837:x1869754990068864:12345-0@lo:502: Request processed in 270us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137389.862650:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783137389.862813:0:5837:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000036acd005 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:5837:1869754990068864:0@lo:502: 00000020:01000000:3.0:1783137389.862841:0:5837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137389.862851:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137389.862854:0:5837:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783137389.862861:0:5837:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783137389.862864:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783137389.862876:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a78f0f62) 00000020:00000080:3.0:1783137389.862892:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783137389.862903:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783137389.863083:0:5837:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783137389.863089:0:5837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac67468e 00000020:00000080:3.0:1783137389.863288:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783137389.863292:0:5837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137389.863295:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137389.863296:0:5837:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783137389.863299:0:5837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137389.863302:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137389.863303:0:5837:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783137389.863307:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783137389.863313:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000fe8aa542) 00000020:00000080:3.0:1783137389.863322:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783137389.863325:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783137389.863327:0:5837:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783137389.863329:0:5837:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783137389.863334:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783137389.863369:0:5837:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000317be024 from lustre-MDT0000, refs=3 00010000:00010000:2.0:1783137389.863609:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783137389.863683:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004d2b9e1c) 00000020:00000080:3.0:1783137389.863692:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783137389.863745:0:5837:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783137389.863749:0:5837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac6746a3 00000020:00000080:3.0:1783137389.864011:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783137389.864017:0:5837:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783137389.864021:0:5837:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88def104ac6746aa 00080000:01000000:3.0:1783137389.864026:0:5837:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783137389.864029:0:5837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac6746b1 00080000:10000000:3.0:1783137389.864336:0:5837:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1783137389.864634:0:5837:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1783137389.876609:0:5837:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1783137390.221854:0:5837:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1783137390.222167:0:5837:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1783137390.235210:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1783137390.235487:0:5837:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783137390.418898:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000362c83a0) 00000020:00000080:0.0:1783137390.418927:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1783137390.419614:0:5837:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783137390.420687:0:5837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac6746bf 00000020:00000080:1.0:1783137390.440740:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1783137390.447276:0:5837:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137390.560539:0:5837:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137390.710185:0:5837:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137390.819269:0:5837:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137390.867283:0:5837:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:3.0:1783137390.894933:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1783137390.983146:0:5837:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1783137391.220041:0:5837:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88def104ac6746c6 00000020:00000080:2.0:1783137391.221749:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783137391.221763:0:5837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137391.221770:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137391.221772:0:5837:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783137391.221775:0:5837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137391.221782:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137391.221783:0:5837:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783137391.221787:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783137391.221844:0:5837:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783137391.221869:0:5837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137391.221873:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137391.221874:0:5837:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783137391.221877:0:5837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137391.221880:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137391.221881:0:5837:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783137391.221883:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783137391.221884:0:5837:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783137391.221921:0:5837:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bfd7407 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:5837:1869754990068992:0@lo:502: 00000100:00100000:2.0:1783137391.221994:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137391.222537:0:5837:0:(client.c:2701:ptlrpc_set_wait()) set 0000000080a92208 going to sleep for 11 seconds 00000100:00100000:2.0:1783137391.233688:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990068992 00000100:00100000:2.0:1783137391.233703:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990068992 00000100:00100000:2.0:1783137391.233759:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783137391.233767:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033bad323 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+9:5837:x1869754990068992:12345-0@lo:502: 00000100:00100000:3.0:1783137391.243002:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033bad323 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+9:5837:x1869754990068992:12345-0@lo:502: Request processed in 9228us (21001us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137391.243017:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783137391.246029:0:5837:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bfd7407 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:5837:1869754990068992:0@lo:502: 00000020:01000000:1.0:1783137391.246193:0:5837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137391.246203:0:5837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137391.246205:0:5837:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783137391.246209:0:5837:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1783137391.247306:0:5795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1783137391.247351:0:5795:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783137391.247369:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137391.247380:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137391.247388:0:5795:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff97099cc6e000 from 1 10000000:01000000:2.0:1783137391.247390:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783137391.247422:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137391.247428:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137391.247447:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137391.247465:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bfd7407 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069120:0@lo:101: 00000100:00100000:2.0:1783137391.247519:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137391.247579:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 0000000080a92208 going to sleep for 11 seconds 00000100:00100000:1.0:1783137391.247969:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990069120 00000100:00100000:1.0:1783137391.247977:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990069120 00000100:00100000:1.0:1783137391.248018:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783137391.248026:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2201dcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+9:5795:x1869754990069120:12345-0@lo:101: 00010000:00010000:1.0:1783137391.248038:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137391.248052:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6746cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.248073:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6746cd expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.248083:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6746cd expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.248092:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bfc4059c, rc 0) 00000100:00100000:1.0:1783137391.248137:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2201dcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+10:5795:x1869754990069120:12345-0@lo:101: Request processed in 112us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137391.248144:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783137391.248364:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bfd7407 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069120:0@lo:101: 00010000:00010000:2.0:1783137391.248377:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137391.248385:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137391.249896:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006bfd7407 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069248:0@lo:256: 00000100:00100000:2.0:1783137391.249950:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137391.250039:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 0000000080a92208 going to sleep for 11 seconds 00000100:00100000:3.0:1783137391.257153:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990069248 00000100:00100000:3.0:1783137391.257166:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990069248 00000100:00100000:1.0:1783137391.257299:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783137391.257308:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e73f1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+10:5795:x1869754990069248:12345-0@lo:256: 20000000:01000000:1.0:1783137391.257363:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783137391.257370:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783137391.257486:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e73f1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+10:5795:x1869754990069248:12345-0@lo:256: Request processed in 179us (7536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137391.257494:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783137391.257832:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006bfd7407 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069248:0@lo:256: 10000000:01000000:3.0:1783137391.258689:0:5795:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783137391.258715:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.258726:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137391.258735:0:5795:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97099cc6e000 from 1 10000000:01000000:3.0:1783137391.258737:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783137391.258771:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.258778:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.258786:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137391.258829:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000036acd005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069376:0@lo:101: 00000100:00100000:3.0:1783137391.258873:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137391.258919:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c212fd06 going to sleep for 11 seconds 00000100:00100000:1.0:1783137391.259586:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990069376 00000100:00100000:1.0:1783137391.259593:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990069376 00000100:00100000:1.0:1783137391.259647:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783137391.259655:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0ce61b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+10:5795:x1869754990069376:12345-0@lo:101: 00010000:00010000:1.0:1783137391.259667:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137391.259679:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6746db expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.259699:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6746db expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.259708:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6746db expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.259716:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080627945, rc 0) 00000100:00100000:1.0:1783137391.259769:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0ce61b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+11:5795:x1869754990069376:12345-0@lo:101: Request processed in 115us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137391.259776:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137391.260028:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000036acd005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069376:0@lo:101: 00010000:00010000:3.0:1783137391.260056:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.260065:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137391.260125:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000036acd005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069504:0@lo:501: 00000100:00100000:3.0:1783137391.260152:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137391.260180:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c212fd06 going to sleep for 11 seconds 00000100:00100000:2.0:1783137391.260233:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990069504 00000100:00100000:2.0:1783137391.260237:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990069504 00000100:00100000:2.0:1783137391.260271:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783137391.260277:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ee74d15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:5795:x1869754990069504:12345-0@lo:501: 00000100:00100000:2.0:1783137391.261197:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ee74d15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:5795:x1869754990069504:12345-0@lo:501: Request processed in 917us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137391.261206:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137391.261309:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000036acd005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069504:0@lo:501: 00000100:00100000:3.0:1783137391.261366:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000036acd005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069632:0@lo:503: 00000100:00100000:3.0:1783137391.261404:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137391.261431:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c212fd06 going to sleep for 11 seconds 00000100:00100000:2.0:1783137391.261733:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990069632 00000100:00100000:2.0:1783137391.261739:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990069632 00000100:00100000:2.0:1783137391.261854:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783137391.261863:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090991a58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:5795:x1869754990069632:12345-0@lo:503: 00000040:00080000:2.0:1783137391.261906:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783137391.262044:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090991a58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:5795:x1869754990069632:12345-0@lo:503: Request processed in 183us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137391.262051:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137391.266234:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000036acd005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069632:0@lo:503: 00000040:00080000:3.0:1783137391.267543:0:5841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1783137391.269825:0:5795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1783137391.269852:0:5795:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137391.269869:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.269883:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137391.269940:0:5795:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783137391.269942:0:5795:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97099cc6e000 10000000:01000000:1.0:1783137391.269945:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97099cc6e000 10000000:01000000:1.0:1783137391.269949:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783137391.269955:0:5795:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97099cc6e000 from 1 10000000:01000000:1.0:1783137391.269958:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783137391.269990:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.269998:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.270007:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137391.270027:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069760:0@lo:101: 00000100:00100000:1.0:1783137391.270088:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137391.270351:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 0000000011703620 going to sleep for 11 seconds 00000100:00100000:3.0:1783137391.270695:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990069760 00000100:00100000:3.0:1783137391.270702:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990069760 00000100:00100000:3.0:1783137391.270746:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783137391.270753:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000616ee812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:5795:x1869754990069760:12345-0@lo:101: 00010000:00010000:3.0:1783137391.270766:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137391.270779:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6746e9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.270825:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6746e9 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.270836:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6746e9 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.270857:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f881f05f, rc 0) 00000100:00100000:3.0:1783137391.270900:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000616ee812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:5795:x1869754990069760:12345-0@lo:101: Request processed in 147us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137391.270906:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783137391.271040:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069760:0@lo:101: 00010000:00010000:1.0:1783137391.271055:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.271062:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137391.271120:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069888:0@lo:501: 00000100:00100000:1.0:1783137391.271146:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137391.271181:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 0000000011703620 going to sleep for 11 seconds 00000100:00100000:3.0:1783137391.271292:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990069888 00000100:00100000:3.0:1783137391.271297:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990069888 00000100:00100000:3.0:1783137391.271482:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137391.271489:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de7334fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:5795:x1869754990069888:12345-0@lo:501: 00000100:00100000:3.0:1783137391.271735:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de7334fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:5795:x1869754990069888:12345-0@lo:501: Request processed in 246us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137391.271743:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783137391.271826:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990069888:0@lo:501: 00000100:00100000:1.0:1783137391.271855:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990070016:0@lo:503: 00000100:00100000:1.0:1783137391.271891:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137391.276508:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 0000000011703620 going to sleep for 11 seconds 00000100:00100000:2.0:1783137391.276664:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990070016 00000100:00100000:2.0:1783137391.276674:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990070016 00000100:00100000:2.0:1783137391.276718:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783137391.276726:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa02b3ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:5795:x1869754990070016:12345-0@lo:503: 00000100:00100000:2.0:1783137391.278830:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa02b3ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:5795:x1869754990070016:12345-0@lo:503: Request processed in 2101us (6934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137391.278843:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783137391.280655:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000770e828c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990070016:0@lo:503: 00000100:00100000:2.0:1783137391.281670:0:5842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000083ccf059 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:5842:1869754990070144:0@lo:502: 00000100:00100000:2.0:1783137391.281743:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137391.281857:0:5842:0:(client.c:2701:ptlrpc_set_wait()) set 000000002e6e7f7c going to sleep for 11 seconds 00000100:00100000:3.0:1783137391.289724:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990070144 00000100:00100000:3.0:1783137391.289738:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990070144 00000100:00100000:2.0:1783137391.290248:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783137391.290257:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d221028f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:5842:x1869754990070144:12345-0@lo:502: 00000100:00100000:2.0:1783137391.290713:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d221028f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:5842:x1869754990070144:12345-0@lo:502: Request processed in 457us (8970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137391.290722:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137391.290933:0:5842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000083ccf059 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:5842:1869754990070144:0@lo:502: 00000020:01000004:0.0:1783137391.290995:0:5842:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783137391.291010:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b7b21be8) 00000020:00000080:0.0:1783137391.291027:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1783137391.291197:0:5842:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000317be024 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783137391.291202:0:5842:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000317be024 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783137391.291204:0:5842:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000317be024 4 00010000:00080000:0.0:1783137391.291230:0:5842:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000086cd26e6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.136@tcp at head 00010000:00010000:0.0:1783137391.322294:0:5842:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1783137391.324016:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783137391.324053:0:5842:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783137391.324065:0:5842:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88def104ac6746fe 00000100:00080000:0.0:1783137391.324075:0:5842:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783137391.324079:0:5842:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000086cd26e6 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:0.0:1783137391.324627:0:5842:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cd645207 x1869754990070272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783137391.324687:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cd645207 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990070272:0@lo:38: 00000100:00100000:1.0:1783137391.324753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783137391.325130:0:5842:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783137391.325235:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990070272 00000100:00100000:3.0:1783137391.325243:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990070272 00000100:00100000:3.0:1783137391.325272:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137391.325278:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000770e828c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1869754990070272:12345-0@lo:38: 00000100:00100000:3.0:1783137391.333827:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000770e828c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1869754990070272:12345-0@lo:38: Request processed in 8539us (9066us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783137391.333841:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137391.334156:0:5842:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002532f9a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:5842:1869754990070400:0@lo:502: 00000100:00100000:0.0:1783137391.334230:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137391.334273:0:5842:0:(client.c:2701:ptlrpc_set_wait()) set 00000000603ba35c going to sleep for 11 seconds 00000100:00100000:2.0:1783137391.334325:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990070400 00000100:00100000:2.0:1783137391.334332:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990070400 00000100:00100000:2.0:1783137391.334386:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783137391.334393:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c7da568 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:5842:x1869754990070400:12345-0@lo:502: 00000100:00100000:2.0:1783137391.334619:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c7da568 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:5842:x1869754990070400:12345-0@lo:502: Request processed in 216us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137391.334626:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783137391.334685:0:5842:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002532f9a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:5842:1869754990070400:0@lo:502: 00000040:00080000:2.0:1783137391.334710:0:5842:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1783137391.337106:0:5795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1783137391.337135:0:5795:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137391.337160:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137391.337173:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783137391.337225:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783137391.337228:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783137391.337229:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137391.337230:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137391.337231:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137391.337232:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137391.337238:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783137391.337239:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783137391.337240:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137391.337241:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137391.337242:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137391.337243:0:5795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137391.337246:0:5795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1783137391.337248:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783137391.337249:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783137391.337250:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137391.337251:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137391.337252:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137391.337253:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137391.337253:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783137391.337254:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783137391.337255:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137391.337255:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137391.337256:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137391.337257:0:5795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137391.337279:0:5795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783137391.337294:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022901c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990070528:0@lo:253: 00000100:00100000:0.0:1783137391.337361:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137391.337402:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set 00000000459df6b4 going to sleep for 11 seconds 00000100:00100000:3.0:1783137391.337450:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990070528 00000100:00100000:3.0:1783137391.337456:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990070528 00000100:00100000:3.0:1783137391.337501:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783137391.337508:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dcff1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:5795:x1869754990070528:12345-0@lo:253: 20000000:01000000:3.0:1783137391.337532:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783137391.337544:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783137391.351627:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783137391.351640:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000086cd26e6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783137391.351648:0:3305:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783137391.351652:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cd645207 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990070272:0@lo:38: 20000000:01000000:1.0:1783137391.455667:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783137391.455686:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783137391.455742:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783137391.456038:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783137391.456057:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.456075:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6746cd expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.456084:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.456121:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6746cd expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137391.456135:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6746cd expref: 12 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137391.456148:0:5830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a815bc3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1869754990070656:0@lo:104: 00000100:00100000:3.0:1783137391.456204:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137391.456252:0:5830:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c212fd06 going to sleep for 11 seconds 00000100:00100000:1.0:1783137391.456443:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990070656 00000100:00100000:1.0:1783137391.456451:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990070656 00000100:00100000:1.0:1783137391.456503:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137391.456511:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6877974 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5830:x1869754990070656:12345-0@lo:104: 00010000:00010000:1.0:1783137391.456523:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.456578:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783137391.456582:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6877974 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5830:x1869754990070656:12345-0@lo:104: Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137391.456591:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783137391.456621:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137391.456626:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.456642:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e550d266 already unused, calling callback (00000000523d4634) 10000000:00010000:1.0:1783137391.456645:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.456653:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137391.456659:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137391.456664:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783137391.456689:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.456695:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137391.456710:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.456717:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: 00000000e550d266/0x88def104ac6746cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6746d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.456732:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137391.456734:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137391.456736:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137391.457118:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137391.457128:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000961069ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990070784:0@lo:103: 00000100:00100000:1.0:1783137391.457159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137391.457205:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990070784 00000100:00100000:1.0:1783137391.457210:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990070784 00010000:00010000:1.0:1783137391.457230:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6746cd expref: 13 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137391.457249:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137391.457255:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc0533b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+13:3306:x1869754990070784:12345-0@lo:103: 00010000:00010000:1.0:1783137391.457264:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137391.457268:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6746cd expref: 13 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.457277:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6746cd expref: 13 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.457291:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.457298:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783137391.458659:0:5800:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001273771s 00010000:00010000:1.0:1783137391.458670:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.458680:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.458686:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.458693:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.458699:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002b49d85d already unused, calling callback (00000000beab0179) 00010000:00010000:1.0:1783137391.458711:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.458718:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.458729:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.458740:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137391.458982:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc0533b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+13:3306:x1869754990070784:12345-0@lo:103: Request processed in 1725us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137391.458992:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783137391.459037:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bfc4059c/0x88def104ac6746d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6746cd expref: 12 pid: 5807 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137391.459055:0:5830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a815bc3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1869754990070656:0@lo:104: 00010000:00010000:1.0:1783137391.459073:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.459081:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.459086:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137391.459091:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b49d85d/0x88def104ac674705 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137391.460232:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000961069ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990070784:0@lo:103: 00000100:00100000:1.0:1783137391.482292:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dcff1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+11:5795:x1869754990070528:12345-0@lo:253: Request processed in 144778us (144926us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137391.482323:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783137391.483688:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022901c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:5795:1869754990070528:0@lo:253: 10000000:01000000:0.0:1783137391.483705:0:5795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783137391.483708:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783137391.483710:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783137391.483711:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137391.483712:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137391.483713:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137391.483714:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137391.483716:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783137391.483717:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783137391.483719:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137391.483720:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137391.483721:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137391.483722:0:5795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783137391.483736:0:5795:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783137391.494309:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137391.496056:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137391.496296:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137391.498696:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137391.499727:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137391.500068:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137391.501574:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137391.502012:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137391.502525:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137391.503076:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137391.503265:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137391.503527:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1783137391.572047:0:5795:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1783137391.601505:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783137391.601699:0:5847:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1783137391.601703:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783137391.602026:0:5848:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783137391.608987:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783137391.609274:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783137391.610561:0:5795:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783137391.610572:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783137391.611951:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783137391.616048:0:5795:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783137391.616746:0:5795:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783137391.617458:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783137391.617711:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783137391.618091:0:5795:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1783137391.623059:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1783137391.623227:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1783137391.625972:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1783137391.626210:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1783137391.626621:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1783137391.627125:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1783137391.627277:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1783137391.628059:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1783137391.628629:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1783137391.628976:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1783137391.629173:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1783137391.629324:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1783137391.629533:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1783137391.629723:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1783137391.629987:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1783137391.630256:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1783137391.630984:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1783137391.631200:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1783137391.631418:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1783137391.631564:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1783137391.634060:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1783137391.634301:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1783137391.636581:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1783137391.637662:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783137391.637931:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1783137391.638150:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1783137391.638334:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783137391.638493:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1783137391.638785:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783137391.639196:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783137391.639397:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783137391.639567:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783137391.645458:0:5795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1783137391.662841:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1783137391.715504:0:5795:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783137391.715538:0:5795:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8bdc1c2b988 00100000:10000000:2.0:1783137391.715545:0:5795:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783137391.716267:0:5795:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783137391.716280:0:5795:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.136@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783137391.716291:0:5795:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783137391.716312:0:5795:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1783137391.793152:0:5848:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783137391.793218:0:5848:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783137391.793223:0:5848:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1783137391.912518:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137392.962168:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137394.023173:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783137394.854900:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783137394.854907:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff97099cc6e000 from 3 10000000:01000000:1.0:1783137394.854911:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783137394.854950:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 000000008679d2bd/0x88def104ac67470c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137394.854962:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 000000008679d2bd/0x88def104ac67470c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137394.854983:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 000000008679d2bd/0x88def104ac67470c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137394.855005:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000096a391bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990070912:0@lo:101: 00000100:00100000:1.0:1783137394.855067:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137394.855113:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set 000000009de0d6e1 going to sleep for 11 seconds 00000100:00100000:1.0:1783137394.855137:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990070912 00000100:00100000:1.0:1783137394.855143:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990070912 00000100:00100000:1.0:1783137394.855198:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783137394.855207:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d046f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:5811:x1869754990070912:12345-0@lo:101: 00010000:00010000:1.0:1783137394.855219:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137394.855231:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062dad83e/0x88def104ac674713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67470c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137394.855263:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062dad83e/0x88def104ac674713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67470c expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137394.855271:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062dad83e/0x88def104ac674713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67470c expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137394.855279:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062dad83e, rc 0) 00000100:00100000:1.0:1783137394.855328:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d046f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990070912:12345-0@lo:101: Request processed in 123us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137394.855671:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783137394.855728:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000096a391bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990070912:0@lo:101: 00010000:00010000:1.0:1783137394.855744:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 000000008679d2bd/0x88def104ac67470c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137394.855752:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 000000008679d2bd/0x88def104ac67470c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137394.855829:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000096a391bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990071040:0@lo:256: 00000100:00100000:1.0:1783137394.855862:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137394.855879:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set 000000009de0d6e1 going to sleep for 11 seconds 00000100:00100000:1.0:1783137394.855893:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990071040 00000100:00100000:1.0:1783137394.855896:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990071040 00000100:00100000:1.0:1783137394.855920:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783137394.855926:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d337da83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990071040:12345-0@lo:256: 20000000:01000000:1.0:1783137394.855940:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783137394.855955:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783137394.855957:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1783137394.856590:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d337da83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990071040:12345-0@lo:256: Request processed in 662us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137394.856664:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783137394.856714:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000096a391bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990071040:0@lo:256: 10000000:01000000:1.0:1783137394.856751:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783137394.856758:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 000000008679d2bd/0x88def104ac67470c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137394.856766:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 000000008679d2bd/0x88def104ac67470c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137395.049374:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137396.220163:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137396.651369:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000096a391bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990071168:0@lo:400: 00000100:00100000:2.0:1783137396.651439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783137396.652209:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783137396.652215:0:5309:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783137396.652218:0:5309:0:(import.c:65:import_set_state_nolock()) 0000000086cd26e6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783137396.652227:0:5309:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000086cd26e6 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:1.0:1783137396.652250:0:5309:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000054378ec7 x1869754990071296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783137396.652295:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000054378ec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990071296:0@lo:38: 00000100:00100000:1.0:1783137396.652330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137396.652415:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990071296 00000100:00100000:0.0:1783137396.652422:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990071296 00000100:00100000:0.0:1783137396.652520:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783137396.652526:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006f1763a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1869754990071296:12345-0@lo:38: 00010000:00080000:0.0:1783137396.652558:0:5816:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:0.0:1783137396.652591:0:5816:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88def104ac67471a 00000004:00100000:0.0:1783137396.652626:0:5816:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783137396.652728:0:5816:0:(import.c:65:import_set_state_nolock()) 00000000edba4291 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783137396.652777:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006f1763a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869754990071296:12345-0@lo:38: Request processed in 249us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137396.652820:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783137396.653509:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000054378ec7 x1869754990071296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783137406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783137396.653525:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783137396.653532:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783137396.653537:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783137396.653539:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000086cd26e6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783137396.653544:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000054378ec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990071296:0@lo:38: 00000100:00100000:3.0:1783137396.661789:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990071168 00000100:00100000:3.0:1783137396.661816:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990071168 00000100:00100000:3.0:1783137396.665533:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783137396.665566:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c4fadce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:3308:x1869754990071168:12345-0@lo:400: 00000100:00100000:3.0:1783137396.665660:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c4fadce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:3308:x1869754990071168:12345-0@lo:400: Request processed in 118us (14222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137396.665693:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783137396.665814:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000096a391bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990071168:0@lo:400: 00010000:00010000:2.0:1783137397.223971:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137398.248682:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137399.274104:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137400.295934:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783137400.567611:0:6093:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783137401.325826:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137401.767427:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000023229e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990071552:0@lo:400: 00000100:00100000:2.0:1783137401.767522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137401.768229:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990071552 00000100:00100000:1.0:1783137401.768237:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990071552 00000100:00100000:1.0:1783137401.768286:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137401.768293:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edaca8bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990071552:12345-0@lo:400: 00000100:00100000:1.0:1783137401.768358:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edaca8bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990071552:12345-0@lo:400: Request processed in 65us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137401.768364:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783137401.768467:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000023229e40 x1869754990071552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137401.768480:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000023229e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990071552:0@lo:400: 00000100:00100000:3.0:1783137401.771590:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000054378ec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990071424:0@lo:400: 00000100:00100000:3.0:1783137401.771657:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137401.771774:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990071424 00000100:00100000:1.0:1783137401.771781:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990071424 00000100:00100000:1.0:1783137401.771990:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783137401.771998:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c6df4d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:3309:x1869754990071424:12345-0@lo:400: 00000100:00100000:1.0:1783137401.772047:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c6df4d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:3309:x1869754990071424:12345-0@lo:400: Request processed in 50us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137401.772055:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783137401.772525:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000054378ec7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990071424:0@lo:400: 00010000:00010000:1.0:1783137402.343238:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137403.367103:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137404.391007:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137405.415424:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137406.439341:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137406.886948:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137406.886979:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004340bba9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990071680:0@lo:400: 00000100:00100000:1.0:1783137406.887045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137406.887093:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000047a35b8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990071808:0@lo:400: 00000100:00100000:1.0:1783137406.887130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137406.887163:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990071680 00000100:00100000:1.0:1783137406.887169:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990071680 00000100:00100000:1.0:1783137406.887208:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783137406.887226:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3154dc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:3306:x1869754990071680:12345-0@lo:400: 00000100:00100000:1.0:1783137406.887272:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3154dc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:3306:x1869754990071680:12345-0@lo:400: Request processed in 58us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137406.887292:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783137406.887320:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990071808 00000100:00100000:1.0:1783137406.887323:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990071808 00000100:00100000:1.0:1783137406.887343:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137406.887347:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ed87865 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990071808:12345-0@lo:400: 00000100:00100000:1.0:1783137406.887377:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ed87865 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990071808:12345-0@lo:400: Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137406.887383:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783137406.887419:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000047a35b8e x1869754990071808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137406.887440:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000047a35b8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990071808:0@lo:400: 00000100:00100000:1.0:1783137406.887465:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004340bba9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990071680:0@lo:400: 00000020:00000080:1.0:1783137406.914840:0:6295:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc675e430 20000000:00000080:1.0:1783137406.914858:0:6295:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9709bc375c00 uarg=0000000000000000 20000000:01000000:1.0:1783137406.914891:0:6295:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783137406.914898:0:6295:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783137406.914903:0:6295:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783137406.915529:0:6295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1783137406.915540:0:6295:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1783137406.930107:0:6295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137406.930368:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783137406.930425:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1783137406.930487:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1783137406.930503:0:6295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783137406.930519:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137406.930537:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6746db expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137406.930552:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137406.930590:0:6295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6746db expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137406.930604:0:6295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6746db expref: 11 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137406.930617:0:6295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004340bba9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6295:1869754990071936:0@lo:104: 00000100:00100000:1.0:1783137406.930677:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137406.930722:0:6295:0:(client.c:2701:ptlrpc_set_wait()) set 000000008f2bed23 going to sleep for 11 seconds 00000100:00100000:3.0:1783137406.931072:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990071936 00000100:00100000:3.0:1783137406.931079:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990071936 00000100:00100000:3.0:1783137406.931130:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137406.931137:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047a35b8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e4795b-54a4-4490-bb2a-864b21234c99+3:6295:x1869754990071936:12345-0@lo:104: 00010000:00010000:3.0:1783137406.931148:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137406.931220:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137406.931225:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047a35b8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e4795b-54a4-4490-bb2a-864b21234c99+3:6295:x1869754990071936:12345-0@lo:104: Request processed in 89us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137406.931232:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783137406.931250:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137406.931255:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137406.931262:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000074c57499 already unused, calling callback (00000000523d4634) 10000000:00010000:3.0:1783137406.931265:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137406.931283:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137406.931289:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137406.931294:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783137406.931316:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137406.931322:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137406.931337:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137406.931343:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: 0000000074c57499/0x88def104ac6746db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6746e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137406.931359:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137406.931361:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137406.931362:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137406.931371:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005157fb7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990072064:0@lo:103: 00000100:00100000:3.0:1783137406.931396:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137406.931812:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990072064 00000100:00100000:2.0:1783137406.931817:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990072064 00010000:00010000:2.0:1783137406.931835:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6746db expref: 12 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137406.931859:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137406.931864:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5c110db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+12:3309:x1869754990072064:12345-0@lo:103: 00010000:00010000:2.0:1783137406.931873:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137406.931877:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6746db expref: 12 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931885:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6746db expref: 12 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931900:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931906:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931930:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931937:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931943:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931948:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931953:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004cf22a4d already unused, calling callback (00000000beab0179) 00010000:00010000:2.0:1783137406.931957:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931963:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931984:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137406.931993:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137406.932029:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5c110db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+12:3309:x1869754990072064:12345-0@lo:103: Request processed in 165us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137406.932036:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137406.932068:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005157fb7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990072064:0@lo:103: 00010000:00010000:0.0:1783137406.932482:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000080627945/0x88def104ac6746e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6746db expref: 11 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137406.932496:0:6295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004340bba9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6295:1869754990071936:0@lo:104: 00010000:00010000:0.0:1783137406.932508:0:6295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137406.932516:0:6295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137406.932521:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137406.932528:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004cf22a4d/0x88def104ac674721 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137407.473468:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137408.487170:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137409.512235:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137410.535036:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137411.566772:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137412.009286:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022901c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990072192:0@lo:400: 00000100:00100000:2.0:1783137412.009356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137412.009508:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990072192 00000100:00100000:3.0:1783137412.009515:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990072192 00000100:00100000:3.0:1783137412.009560:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783137412.009575:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b64fa46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:3306:x1869754990072192:12345-0@lo:400: 00000100:00100000:1.0:1783137412.010920:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990072320:0@lo:400: 00000100:00100000:1.0:1783137412.010969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137412.011368:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b64fa46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:3306:x1869754990072192:12345-0@lo:400: Request processed in 1794us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137412.011388:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137412.011524:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990072320 00000100:00100000:0.0:1783137412.011531:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990072320 00000100:00100000:0.0:1783137412.011567:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137412.011574:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cce99df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990072320:12345-0@lo:400: 00000100:00100000:0.0:1783137412.011631:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cce99df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990072320:12345-0@lo:400: Request processed in 57us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137412.011637:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783137412.011678:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005fd09e1f x1869754990072320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137412.011690:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990072320:0@lo:400: 00000100:00100000:2.0:1783137412.012887:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022901c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990072192:0@lo:400: 00010000:00010000:3.0:1783137412.583026:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137413.607468:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783137414.041695:0:6616:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783137414.041699:0:6616:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1783137414.041819:0:6616:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000b61205ca 00000020:01000004:0.0:1783137414.041835:0:6616:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1783137414.041847:0:6616:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783137414.041859:0:6616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000008c35e00f) 00000020:00000080:0.0:1783137414.041873:0:6616:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783137414.132059:0:6616:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1783137414.134854:0:6616:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783137414.183848:0:6616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783137414.207516:0:6616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783137414.207549:0:6616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783137414.207604:0:6616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783137414.207629:0:6616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783137414.209489:0:6616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783137414.209505:0:6616:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783137414.209521:0:6616:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88def104ac67472f 00000020:01000004:3.0:1783137414.209529:0:6616:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1783137414.209552:0:6616:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.136@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783137414.209555:0:6616:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783137414.209561:0:6616:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783137414.209566:0:6616:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783137414.209579:0:6616:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000034735b4f) 00000020:00000080:3.0:1783137414.209592:0:6616:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1783137414.215369:0:6616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137414.215530:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783137414.215537:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783137414.220714:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783137414.220729:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783137414.223042:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783137414.223052:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783137414.240568:0:6616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783137414.240749:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783137414.240756:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783137414.243239:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783137414.243250:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783137414.334656:0:6616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137414.335245:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783137414.335252:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783137414.354492:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783137414.354587:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783137414.357932:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783137414.357949:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783137414.365713:0:6616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137414.365915:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783137414.365922:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783137414.384457:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783137414.384469:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783137414.520870:0:6616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137414.521060:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783137414.521066:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783137414.523151:0:6616:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783137414.523163:0:6616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783137414.523912:0:6616:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783137414.523943:0:6616:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1783137414.523949:0:6616:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783137414.588315:0:6616:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783137414.588362:0:6616:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.136@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1783137414.588366:0:6616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783137414.588368:0:6616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783137414.588369:0:6616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137414.588370:0:6616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137414.588371:0:6616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137414.588373:0:6616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137414.588374:0:6616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783137414.588376:0:6616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783137414.588377:0:6616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783137414.588379:0:6616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137414.588380:0:6616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783137414.588383:0:6616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1783137414.588385:0:6616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783137414.588386:0:6616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783137414.588388:0:6616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137414.588389:0:6616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137414.588390:0:6616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137414.588391:0:6616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137414.588392:0:6616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783137414.588393:0:6616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783137414.588394:0:6616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783137414.588395:0:6616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137414.588396:0:6616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783137414.588423:0:6616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783137414.588438:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000041b35b2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990072448:0@lo:253: 00000100:00100000:2.0:1783137414.588501:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137414.588832:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 00000000606d5258 going to sleep for 11 seconds 00000100:00100000:1.0:1783137414.590774:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990072448 00000100:00100000:1.0:1783137414.590786:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990072448 00000100:00100000:1.0:1783137414.591303:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783137414.591312:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad39bf06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990072448:12345-0@lo:253: 20000000:01000000:1.0:1783137414.591374:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783137414.591379:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1783137414.591384:0:5807:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1783137414.591386:0:5807:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1783137414.592641:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137414.595050:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1783137414.595135:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1783137414.595193:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1783137414.595201:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1783137414.595508:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1783137414.595830:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1783137414.596497:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1783137414.596734:0:5807:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.136@tcp 20000000:01000000:1.0:1783137414.596736:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:1.0:1783137414.596779:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1783137414.596789:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783137414.597360:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1783137414.597410:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:1.0:1783137414.597455:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1783137414.597464:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783137414.597492:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1783137414.597769:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1783137414.614125:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1783137414.614161:0:5807:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.136@tcp 20000000:01000000:1.0:1783137414.614163:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:1.0:1783137414.614202:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1783137414.614211:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783137414.614244:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1783137414.614252:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:1.0:1783137414.614296:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1783137414.614307:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783137414.614363:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1783137414.614400:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1783137414.614419:0:5807:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783137414.614421:0:5807:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783137414.614425:0:5807:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783137414.614437:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783137414.614439:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783137414.614478:0:5807:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783137414.614480:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783137414.619186:0:6631:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1783137414.619617:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1783137414.619664:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1783137414.619740:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1783137414.619753:0:5807:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783137414.619756:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783137414.620984:0:6632:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1783137414.621045:0:6632:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1783137414.621617:0:6632:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00010000:00010000:3.0:1783137414.631765:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783137414.636356:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1783137414.636411:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1783137414.636479:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1783137414.636496:0:5807:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783137414.636498:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783137414.640516:0:6633:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1783137414.640612:0:6633:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1783137414.640663:0:6633:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1783137414.641176:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1783137414.641214:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1783137414.641244:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1783137414.641261:0:5807:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1783137414.641263:0:5807:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1783137414.641271:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783137414.641285:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.641301:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67465d expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.641308:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674679 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.641314:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6746e9 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.641320:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.641362:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6746e9 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.641396:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6746e9 expref: 11 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137414.641409:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c0ea4449 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990072576:0@lo:104: 00000100:00100000:2.0:1783137414.641467:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137414.641675:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac674679 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.641683:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac674679 expref: 11 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137414.641690:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e49c6a3d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990072704:0@lo:104: 00000100:00100000:2.0:1783137414.641712:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137414.648608:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac67465d expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.648628:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac67465d expref: 11 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137414.648642:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000050884697 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990072832:0@lo:104: 00000100:00100000:2.0:1783137414.648691:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.648909:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990072576 00000100:00100000:1.0:1783137414.648917:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990072576 00000100:00100000:1.0:1783137414.648956:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990072704 00000100:00100000:1.0:1783137414.648969:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990072704 00000100:00100000:1.0:1783137414.648985:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783137414.648992:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a79a76b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:5807:x1869754990072576:12345-0@lo:104: 00010000:00010000:1.0:1783137414.649004:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.651498:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783137414.651515:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a79a76b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:5807:x1869754990072576:12345-0@lo:104: Request processed in 2519us (10043us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137414.651528:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783137414.651566:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783137414.651578:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6f29cc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5807:x1869754990072704:12345-0@lo:104: 00010000:00010000:1.0:1783137414.651593:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.651932:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783137414.651938:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.651947:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000069aa244b already unused, calling callback (00000000523d4634) 10000000:00010000:0.0:1783137414.651951:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.651987:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137414.651994:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137414.651999:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137414.652040:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652046:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137414.652064:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652080:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac6746e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6746f0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652096:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137414.652098:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652104:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f879b0b already unused, calling callback (00000000523d4634) 10000000:00010000:0.0:1783137414.652106:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652111:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137414.652116:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137414.652127:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137414.652140:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652145:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137414.652150:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652155:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674680 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652169:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137414.652171:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137414.652173:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137414.652198:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007b53cddf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990073088:0@lo:103: 00000100:00100000:0.0:1783137414.652238:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.652277:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137414.652283:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990072960:0@lo:103: 00000100:00100000:0.0:1783137414.652303:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.652329:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990073088 00000100:00100000:0.0:1783137414.652335:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990073088 00010000:00010000:0.0:1783137414.652370:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674679 expref: 12 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137414.652396:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990072960 00000100:00100000:0.0:1783137414.652398:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990072960 00010000:00010000:0.0:1783137414.652408:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6746e9 expref: 13 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137414.652432:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137414.652439:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047baff46 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+13:3309:x1869754990073088:12345-0@lo:103: 00010000:00010000:0.0:1783137414.652449:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137414.652454:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674679 expref: 13 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652463:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac674679 expref: 13 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652478:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137414.652506:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047baff46 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+13:3309:x1869754990073088:12345-0@lo:103: Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137414.652512:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137414.652524:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137414.652529:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056a1eff0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+12:3309:x1869754990072960:12345-0@lo:103: 00010000:00010000:0.0:1783137414.652536:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137414.652539:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6746e9 expref: 12 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652547:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6746e9 expref: 12 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.652554:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137414.652573:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056a1eff0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+12:3309:x1869754990072960:12345-0@lo:103: Request processed in 44us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137414.652578:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137414.652607:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990072960:0@lo:103: 00000100:00100000:0.0:1783137414.652623:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007b53cddf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990073088:0@lo:103: 00000100:00100000:2.0:1783137414.652858:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f4b78f83 going to sleep for 11 seconds 00010000:00010000:2.0:1783137414.652871:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f881f05f/0x88def104ac6746f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6746e9 expref: 11 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137414.652891:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c0ea4449 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990072576:0@lo:104: 00010000:00010000:2.0:1783137414.652899:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d5dcd71d/0x88def104ac674680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac674679 expref: 10 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137414.652917:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e49c6a3d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990072704:0@lo:104: 00010000:00010000:1.0:1783137414.655217:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1783137414.655233:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6f29cc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5807:x1869754990072704:12345-0@lo:104: Request processed in 3657us (13517us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137414.655246:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783137414.655276:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990072832 00000100:00100000:1.0:1783137414.655298:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990072832 00000100:00100000:1.0:1783137414.655326:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783137414.655332:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f927ece pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5807:x1869754990072832:12345-0@lo:104: 00010000:00010000:1.0:1783137414.655354:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655459:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783137414.655463:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f927ece pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5807:x1869754990072832:12345-0@lo:104: Request processed in 133us (6773us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137414.655470:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783137414.655505:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137414.655510:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655517:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005eaaafed already unused, calling callback (00000000523d4634) 10000000:00010000:1.0:1783137414.655520:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655527:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137414.655533:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137414.655539:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783137414.655570:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655577:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137414.655593:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655604:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: 000000005eaaafed/0x88def104ac67465d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674664 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655621:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137414.655622:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137414.655624:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137414.655637:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003f1bd7ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990073216:0@lo:103: 00000100:00100000:1.0:1783137414.655671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.655720:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990073216 00000100:00100000:1.0:1783137414.655724:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990073216 00010000:00010000:1.0:1783137414.655740:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67465d expref: 10 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137414.655759:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783137414.655764:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090444f3c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+10:3306:x1869754990073216:12345-0@lo:103: 00010000:00010000:1.0:1783137414.655773:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137414.655776:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67465d expref: 10 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655783:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac67465d expref: 10 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655819:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655825:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655838:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655848:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655853:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655858:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655863:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e550d266 already unused, calling callback (00000000beab0179) 00010000:00010000:1.0:1783137414.655865:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.655871:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.656007:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bcd1cb69/0x88def104ac674664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac67465d expref: 10 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137414.656018:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000050884697 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990072832:0@lo:104: 00010000:00010000:0.0:1783137414.656038:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.656046:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.656051:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783137414.656058:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1783137414.656259:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.656268:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e550d266/0x88def104ac67473d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.656282:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137414.656321:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090444f3c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+9:3306:x1869754990073216:12345-0@lo:103: Request processed in 558us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137414.656328:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783137414.656460:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003f1bd7ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990073216:0@lo:103: 00010000:00010000:2.0:1783137414.656511:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137414.768810:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad39bf06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+8:6616:x1869754990072448:12345-0@lo:253: Request processed in 177477us (180286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.768825:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783137414.769041:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000041b35b2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990072448:0@lo:253: 10000000:01000000:1.0:1783137414.769055:0:6616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783137414.769059:0:6616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783137414.769202:0:6616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783137414.769204:0:6616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137414.769205:0:6616:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1783137414.769206:0:6616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137414.769207:0:6616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137414.769209:0:6616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137414.769210:0:6616:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783137414.769212:0:6616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137414.769213:0:6616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783137414.769231:0:6616:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b61205ca from lustre-OST0000 10000000:01000000:1.0:1783137414.769255:0:6616:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783137414.769257:0:6616:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783137414.769265:0:6616:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9709873db380 local copy 10000000:01000000:1.0:1783137414.769268:0:6616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783137414.769302:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.769312:0:6616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.769320:0:6616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137414.769336:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073344:0@lo:101: 00000100:00100000:1.0:1783137414.769383:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.769439:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 000000001e9cfb17 going to sleep for 11 seconds 00000100:00100000:2.0:1783137414.769816:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990073344 00000100:00100000:2.0:1783137414.769823:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990073344 00000100:00100000:2.0:1783137414.769867:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783137414.769875:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b55a72ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+8:6616:x1869754990073344:12345-0@lo:101: 00010000:00010000:2.0:1783137414.770293:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137414.770306:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5dcd71d/0x88def104ac67474b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674744 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.770328:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5dcd71d/0x88def104ac67474b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674744 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.770350:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5dcd71d/0x88def104ac67474b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674744 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.770358:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5dcd71d, rc 0) 00000100:00100000:2.0:1783137414.770404:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b55a72ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+9:6616:x1869754990073344:12345-0@lo:101: Request processed in 530us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.770410:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783137414.770560:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073344:0@lo:101: 00010000:00010000:1.0:1783137414.770573:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.770581:0:6616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137414.770694:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073472:0@lo:501: 00000100:00100000:1.0:1783137414.771615:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.771655:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 000000001e9cfb17 going to sleep for 11 seconds 00000100:00100000:2.0:1783137414.772833:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990073472 00000100:00100000:2.0:1783137414.772843:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990073472 00000100:00100000:2.0:1783137414.773141:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783137414.773149:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b2b93f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+9:6616:x1869754990073472:12345-0@lo:501: 00000100:00100000:2.0:1783137414.773398:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b2b93f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+9:6616:x1869754990073472:12345-0@lo:501: Request processed in 250us (1786us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783137414.773406:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783137414.777985:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073472:0@lo:501: 10000000:01000000:1.0:1783137414.778019:0:6616:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783137414.778098:0:6616:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783137414.778106:0:6616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.778116:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.778122:0:6616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.778147:0:6616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783137414.778175:0:6616:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9709886eb800 10000000:01000000:1.0:1783137414.778180:0:6616:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783137414.778185:0:6616:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9709873db380 10000000:01000000:1.0:1783137414.778187:0:6616:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1783137414.778190:0:6616:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9709873db380 from 1 10000000:01000000:1.0:1783137414.778193:0:6616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783137414.778223:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac674752 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.778230:0:6616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac674752 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.778255:0:6616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac674752 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137414.778272:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073600:0@lo:101: 00000100:00100000:1.0:1783137414.778333:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.778384:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 0000000039a488f4 going to sleep for 11 seconds 00000100:00100000:3.0:1783137414.782624:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990073600 00000100:00100000:3.0:1783137414.782639:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990073600 00000100:00100000:3.0:1783137414.782706:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783137414.782714:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000027261ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+9:6616:x1869754990073600:12345-0@lo:101: 00010000:00010000:3.0:1783137414.782738:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137414.782756:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074c57499/0x88def104ac674759 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674752 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.782781:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074c57499/0x88def104ac674759 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674752 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.782827:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074c57499/0x88def104ac674759 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674752 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.782837:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074c57499, rc 0) 00000100:00100000:3.0:1783137414.782903:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000027261ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990073600:12345-0@lo:101: Request processed in 190us (4571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137414.782910:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1783137414.783281:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137414.783287:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.783296:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f879b0b already unused, calling callback (00000000523d4634) 10000000:00010000:2.0:1783137414.783299:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.783308:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137414.783314:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137414.783320:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783137414.783352:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.783358:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137414.783383:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.783389:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: 000000008f879b0b/0x88def104ac674744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x88def104ac67474b expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.783413:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137414.783415:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137414.783432:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137414.783487:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137414.783501:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000338a1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990073728:0@lo:103: 00000100:00100000:0.0:1783137414.783538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137414.783622:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990073728 00000100:00100000:2.0:1783137414.783627:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990073728 00000100:00100000:2.0:1783137414.783666:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137414.783672:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b53cddf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+10:3306:x1869754990073728:12345-0@lo:103: 00010000:00010000:2.0:1783137414.783682:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137414.783692:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d5dcd71d/0x88def104ac67474b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674744 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.783704:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137414.783741:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b53cddf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+9:3306:x1869754990073728:12345-0@lo:103: Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.783748:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137414.783916:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000338a1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990073728:0@lo:103: 00000100:00100000:1.0:1783137414.784088:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073600:0@lo:101: 00010000:00010000:1.0:1783137414.784102:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac674752 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674759 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.784110:0:6616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac674752 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674759 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137414.784125:0:6616:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783137414.784142:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac674752 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674759 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.784148:0:6616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 0000000069aa244b/0x88def104ac674752 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674759 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137414.784157:0:6616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783137414.784161:0:6616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783137414.784167:0:6616:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783137414.784170:0:6616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783137414.784184:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 00000000973cc3ec/0x88def104ac674760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.784191:0:6616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 00000000973cc3ec/0x88def104ac674760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.784206:0:6616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 00000000973cc3ec/0x88def104ac674760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137414.784219:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073856:0@lo:101: 00000100:00100000:1.0:1783137414.784248:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.784277:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 0000000039a488f4 going to sleep for 11 seconds 00000100:00100000:3.0:1783137414.784386:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990073856 00000100:00100000:3.0:1783137414.784391:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990073856 00000100:00100000:3.0:1783137414.784422:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783137414.784428:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae437c4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+9:6616:x1869754990073856:12345-0@lo:101: 00010000:00010000:3.0:1783137414.784437:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137414.784446:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5309b92/0x88def104ac674767 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674760 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.784459:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5309b92/0x88def104ac674767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674760 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.784474:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5309b92/0x88def104ac674767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674760 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.784481:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5309b92, rc 0) 00000100:00100000:3.0:1783137414.784517:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae437c4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990073856:12345-0@lo:101: Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137414.784523:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783137414.784655:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073856:0@lo:101: 00010000:00010000:1.0:1783137414.784664:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 00000000973cc3ec/0x88def104ac674760 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.784670:0:6616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 00000000973cc3ec/0x88def104ac674760 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137414.784768:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073984:0@lo:501: 00000100:00100000:1.0:1783137414.784828:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.784839:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 0000000039a488f4 going to sleep for 11 seconds 00000100:00100000:0.0:1783137414.785004:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990073984 00000100:00100000:0.0:1783137414.785009:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990073984 00000100:00100000:0.0:1783137414.785037:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783137414.785043:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004525fd8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990073984:12345-0@lo:501: 00000100:00100000:0.0:1783137414.785282:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004525fd8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990073984:12345-0@lo:501: Request processed in 237us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137414.785290:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783137414.785646:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990073984:0@lo:501: 00000100:00100000:1.0:1783137414.785677:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074112:0@lo:503: 00000100:00100000:1.0:1783137414.785715:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.785750:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 0000000039a488f4 going to sleep for 11 seconds 00000100:00100000:2.0:1783137414.785859:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990074112 00000100:00100000:2.0:1783137414.785864:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990074112 00000100:00100000:2.0:1783137414.785894:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783137414.785900:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebf60a2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990074112:12345-0@lo:503: 00000100:00100000:2.0:1783137414.786046:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebf60a2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990074112:12345-0@lo:503: Request processed in 146us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.786052:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783137414.786249:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074112:0@lo:503: 00000040:00080000:1.0:1783137414.786542:0:6616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783137414.786608:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074240:0@lo:502: 00000100:00100000:1.0:1783137414.786639:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.786668:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 0000000039a488f4 going to sleep for 11 seconds 00000100:00100000:3.0:1783137414.786735:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990074240 00000100:00100000:3.0:1783137414.786739:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990074240 00000100:00100000:3.0:1783137414.786769:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783137414.786775:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c9d2e5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990074240:12345-0@lo:502: 00000100:00100000:3.0:1783137414.786941:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c9d2e5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990074240:12345-0@lo:502: Request processed in 165us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137414.786948:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783137414.787237:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074240:0@lo:502: 00000040:00080000:1.0:1783137414.787472:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783137414.787521:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783137414.787554:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783137414.787601:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783137414.787635:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783137414.787669:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783137414.787690:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074368:0@lo:502: 00000100:00100000:1.0:1783137414.787736:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.787829:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 0000000039a488f4 going to sleep for 11 seconds 00000100:00100000:0.0:1783137414.793250:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990074368 00000100:00100000:0.0:1783137414.793263:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990074368 00000100:00100000:0.0:1783137414.793379:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783137414.793388:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e45e709d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990074368:12345-0@lo:502: 00000100:00100000:0.0:1783137414.793641:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e45e709d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990074368:12345-0@lo:502: Request processed in 254us (5905us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137414.793649:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783137414.793750:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001c7e640c pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074368:0@lo:502: 00000040:00080000:1.0:1783137414.793936:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1783137414.793950:0:6616:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1783137414.797907:0:6635:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783137414.797917:0:6635:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783137414.797931:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137414.797933:0:6635:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783137414.797939:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783137414.797952:0:6635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000b6d3dc25) 00000020:00000080:2.0:1783137414.797972:0:6635:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783137414.797979:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783137414.798055:0:6635:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b61205ca from lustre-OST0000, refs=2 00080000:01000000:2.0:1783137414.798063:0:6635:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783137414.798085:0:6635:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88def104ac674775 00010000:00010000:2.0:1783137414.810215:0:6635:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1783137414.810510:0:6635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1783137414.822655:0:6635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783137414.824890:0:6635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1783137414.839671:0:6635:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1783137414.841521:0:6635:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1783137414.847291:0:6635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783137414.847303:0:6635:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137414.847309:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137414.847311:0:6635:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783137414.847315:0:6635:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137414.847318:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137414.847319:0:6635:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783137414.847322:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783137414.847323:0:6635:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783137414.847386:0:6635:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137414.847390:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137414.847391:0:6635:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783137414.847394:0:6635:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783137414.847553:0:6616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1783137414.847575:0:6616:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783137414.847590:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: 00000000973cc3ec/0x88def104ac674760 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.847602:0:6616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: 00000000973cc3ec/0x88def104ac674760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137414.847610:0:6616:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709886eb800 from 1 10000000:01000000:0.0:1783137414.847612:0:6616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783137414.847645:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: 00000000bcd1cb69/0x88def104ac67477c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.847653:0:6616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: 00000000bcd1cb69/0x88def104ac67477c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.847662:0:6616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: 00000000bcd1cb69/0x88def104ac67477c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137414.847682:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074496:0@lo:101: 00000100:00100000:0.0:1783137414.847744:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.847815:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d99bd659 going to sleep for 11 seconds 00000100:00100000:3.0:1783137414.852185:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990074496 00000100:00100000:3.0:1783137414.852199:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990074496 00000100:00100000:3.0:1783137414.852255:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783137414.852262:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ef8a722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+10:6616:x1869754990074496:12345-0@lo:101: 00010000:00010000:3.0:1783137414.852278:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137414.852295:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003fac49f9/0x88def104ac674783 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67477c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.852318:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fac49f9/0x88def104ac674783 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67477c expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.852328:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003fac49f9/0x88def104ac674783 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67477c expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.852348:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003fac49f9, rc 0) 00000100:00100000:3.0:1783137414.852415:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ef8a722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990074496:12345-0@lo:101: Request processed in 153us (4671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137414.852422:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783137414.852841:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074496:0@lo:101: 00010000:00010000:0.0:1783137414.852864:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: 00000000bcd1cb69/0x88def104ac67477c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.852873:0:6616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: 00000000bcd1cb69/0x88def104ac67477c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137414.852995:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074624:0@lo:501: 00000100:00100000:0.0:1783137414.853031:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.853065:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d99bd659 going to sleep for 11 seconds 00000100:00100000:2.0:1783137414.854180:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990074624 00000100:00100000:2.0:1783137414.854189:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990074624 00000100:00100000:2.0:1783137414.854229:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783137414.854236:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017ec937c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990074624:12345-0@lo:501: 00000100:00100000:2.0:1783137414.854488:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017ec937c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990074624:12345-0@lo:501: Request processed in 252us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.854497:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783137414.854605:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074624:0@lo:501: 00000100:00100000:0.0:1783137414.854640:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074752:0@lo:503: 00000100:00100000:0.0:1783137414.854680:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.854709:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d99bd659 going to sleep for 11 seconds 00000100:00100000:3.0:1783137414.854751:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990074752 00000100:00100000:3.0:1783137414.854755:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990074752 00000100:00100000:3.0:1783137414.854781:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783137414.854786:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016518913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990074752:12345-0@lo:503: 00000100:00100000:3.0:1783137414.855030:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016518913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990074752:12345-0@lo:503: Request processed in 244us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137414.855037:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783137414.855196:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074752:0@lo:503: 00000040:00080000:0.0:1783137414.855434:0:6616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783137414.855491:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074880:0@lo:502: 00000100:00100000:0.0:1783137414.855521:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.855550:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 000000006c790813 going to sleep for 11 seconds 00000100:00100000:2.0:1783137414.855620:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990074880 00000100:00100000:2.0:1783137414.855624:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990074880 00000100:00100000:2.0:1783137414.855647:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783137414.855653:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032a5804e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990074880:12345-0@lo:502: 00000100:00100000:2.0:1783137414.855775:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032a5804e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990074880:12345-0@lo:502: Request processed in 122us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.855780:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783137414.855873:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990074880:0@lo:502: 00000040:00080000:0.0:1783137414.856209:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783137414.856253:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783137414.856272:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075008:0@lo:502: 00000100:00100000:0.0:1783137414.856302:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.856328:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d99bd659 going to sleep for 11 seconds 00000100:00100000:0.0:1783137414.856352:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990075008 00000100:00100000:0.0:1783137414.856356:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990075008 00000100:00100000:0.0:1783137414.856382:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783137414.856387:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a8f14ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990075008:12345-0@lo:502: 00000100:00100000:0.0:1783137414.856499:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a8f14ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990075008:12345-0@lo:502: Request processed in 112us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137414.856506:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783137414.856536:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005fd09e1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075008:0@lo:502: 00000040:00080000:0.0:1783137414.856618:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783137414.856627:0:6616:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1783137414.883310:0:6639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137414.883323:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137414.883325:0:6639:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783137414.883333:0:6639:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9709886eb800 00000020:00000080:1.0:1783137414.883335:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783137414.883380:0:6639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137414.883384:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137414.883386:0:6639:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783137414.883388:0:6639:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783137414.886996:0:6616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783137414.887034:0:6616:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783137414.887057:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.887176:0:6616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137414.893114:0:6616:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783137414.893122:0:6616:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9709886eb800 10000000:01000000:3.0:1783137414.893126:0:6616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9709886eb800 10000000:01000000:3.0:1783137414.893131:0:6616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783137414.893138:0:6616:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9709886eb800 from 1 10000000:01000000:3.0:1783137414.893141:0:6616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783137414.893190:0:6616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.893201:0:6616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.893211:0:6616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137414.893232:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075136:0@lo:101: 00000100:00100000:3.0:1783137414.893296:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137414.893352:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab290240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137414.893430:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990075136 00000100:00100000:2.0:1783137414.893438:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990075136 00000100:00100000:2.0:1783137414.893474:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783137414.893481:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990075136:12345-0@lo:101: 00010000:00010000:2.0:1783137414.893493:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137414.893516:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67478a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.893537:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67478a expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.893547:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67478a expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.893554:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2045000, rc 0) 00000100:00100000:2.0:1783137414.893598:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990075136:12345-0@lo:101: Request processed in 117us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.893605:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783137414.894009:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075136:0@lo:101: 00010000:00010000:3.0:1783137414.894024:0:6616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137414.894033:0:6616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137414.894144:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075264:0@lo:501: 00000100:00100000:3.0:1783137414.894172:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137414.894200:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab290240 going to sleep for 11 seconds 00000100:00100000:1.0:1783137414.894247:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990075264 00000100:00100000:1.0:1783137414.894251:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990075264 00000100:00100000:1.0:1783137414.894283:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783137414.894291:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990075264:12345-0@lo:501: 00000100:00100000:1.0:1783137414.894538:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990075264:12345-0@lo:501: Request processed in 247us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137414.894545:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783137414.894721:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075264:0@lo:501: 00000100:00100000:3.0:1783137414.894748:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075392:0@lo:503: 00000100:00100000:3.0:1783137414.894785:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137414.894833:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab290240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137414.894923:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990075392 00000100:00100000:0.0:1783137414.894928:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990075392 00000100:00100000:0.0:1783137414.894948:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137414.894955:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990075392:12345-0@lo:503: 00000100:00100000:0.0:1783137414.895094:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990075392:12345-0@lo:503: Request processed in 139us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137414.895101:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137414.895139:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075392:0@lo:503: 00000040:00080000:0.0:1783137414.895370:0:6616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783137414.895420:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075520:0@lo:502: 00000100:00100000:0.0:1783137414.895582:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.895607:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ceb5600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137414.895620:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990075520 00000100:00100000:0.0:1783137414.895624:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990075520 00000100:00100000:0.0:1783137414.895641:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783137414.895646:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990075520:12345-0@lo:502: 00000100:00100000:0.0:1783137414.895784:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990075520:12345-0@lo:502: Request processed in 138us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137414.895820:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783137414.895857:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075520:0@lo:502: 00000040:00080000:0.0:1783137414.896100:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783137414.896148:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783137414.896181:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783137414.896225:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783137414.896263:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783137414.896309:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783137414.896359:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783137414.896393:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783137414.896970:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783137414.897016:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783137414.897052:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783137414.897115:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783137414.897154:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783137414.897187:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783137414.897230:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783137414.897264:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783137414.897310:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783137414.897380:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783137414.897418:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783137414.898012:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783137414.898059:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783137414.898092:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783137414.898125:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783137414.898188:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783137414.898226:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783137414.898258:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783137414.898304:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783137414.898352:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1783137414.898490:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075648:0@lo:502: 00000100:00100000:0.0:1783137414.898632:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.898683:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ceb5600 going to sleep for 11 seconds 00000100:00100000:2.0:1783137414.898872:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990075648 00000100:00100000:2.0:1783137414.898878:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990075648 00000100:00100000:2.0:1783137414.898923:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783137414.898932:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990075648:12345-0@lo:502: 00000100:00100000:2.0:1783137414.899117:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990075648:12345-0@lo:502: Request processed in 184us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.899124:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783137414.899257:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990075648:0@lo:502: 00000040:00080000:0.0:1783137414.899322:0:6616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783137414.899332:0:6616:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1783137414.900112:0:6640:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783137414.900126:0:6640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff970988740000) 00000020:00000080:2.0:1783137414.900149:0:6640:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1783137414.900294:0:6640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9709886eb800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783137414.900298:0:6640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9709886eb800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783137414.900301:0:6640:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9709886eb800 3 00010000:00080000:2.0:1783137414.900333:0:6640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9709b7c9f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.136@tcp at head 00010000:00010000:2.0:1783137414.901994:0:6640:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1783137414.902076:0:6640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783137414.902106:0:6640:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783137414.902117:0:6640:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x88def104ac67479f 00000100:00080000:2.0:1783137414.902126:0:6640:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783137414.902132:0:6640:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9709b7c9f000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:2.0:1783137414.902161:0:6640:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bd917100 x1869754990075776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783137414.902183:0:6640:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783137414.902253:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990075904:0@lo:400: 00000100:00100000:2.0:1783137414.902303:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137414.902358:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990075904 00000100:00100000:2.0:1783137414.902365:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990075904 00000100:00100000:2.0:1783137414.902410:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137414.902418:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990075904:12345-0@lo:400: 00000100:00100000:2.0:1783137414.902460:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990075904:12345-0@lo:400: Request processed in 43us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.902467:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783137414.902495:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9709bd916680 x1869754990075904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137414.902507:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990075904:0@lo:400: 00000100:00100000:3.0:1783137414.903037:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1869754990075776:0@lo:38: 00000100:00100000:3.0:1783137414.903071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1783137414.906049:0:6640:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1783137414.907568:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990075776 00000100:00100000:2.0:1783137414.907593:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990075776 00000100:00100000:2.0:1783137414.907638:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137414.907645:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1869754990075776:12345-0@lo:38: 00010000:00080000:2.0:1783137414.907671:0:5815:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:2.0:1783137414.907700:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88def104ac6747a6 00000004:00100000:2.0:1783137414.907714:0:5815:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783137414.907746:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9709b7c9d000 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1783137414.908722:0:6616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1783137414.908755:0:6616:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137414.908780:0:6616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137414.908815:0:6616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783137414.908860:0:6616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783137414.908863:0:6616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783137414.908864:0:6616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137414.908865:0:6616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137414.908866:0:6616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137414.908867:0:6616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137414.908869:0:6616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137414.908870:0:6616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137414.908871:0:6616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137414.908873:0:6616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137414.908874:0:6616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137414.908878:0:6616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1783137414.908880:0:6616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783137414.908882:0:6616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783137414.908883:0:6616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137414.908884:0:6616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137414.908884:0:6616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137414.908886:0:6616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137414.908887:0:6616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137414.908888:0:6616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137414.908889:0:6616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137414.908890:0:6616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137414.908896:0:6616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137414.908917:0:6616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783137414.908931:0:6616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990076032:0@lo:253: 00000100:00100000:0.0:1783137414.909622:0:6616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137414.909666:0:6616:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a092f840 going to sleep for 11 seconds 00000100:00100000:1.0:1783137414.909714:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990076032 00000100:00100000:1.0:1783137414.909721:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990076032 00000100:00100000:1.0:1783137414.909767:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783137414.909776:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:6616:x1869754990076032:12345-0@lo:253: 20000000:01000000:1.0:1783137414.909835:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783137414.909847:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783137414.920022:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869754990075776:12345-0@lo:38: Request processed in 12369us (16943us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.920034:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783137414.920124:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9709bd917100 x1869754990075776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783137424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137414.920136:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783137414.920148:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1783137414.920155:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783137414.920160:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783137414.920163:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b7c9f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783137414.920170:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1869754990075776:0@lo:38: 20000000:01000000:1.0:1783137414.946363:0:5807:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783137414.946380:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1783137414.946401:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783137414.946405:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783137414.946426:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.946444:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2172600/0x88def104ac674713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67470c expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.946454:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.946489:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2172600/0x88def104ac674713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac67470c expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.946502:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2172600/0x88def104ac674713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac67470c expref: 12 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137414.946514:0:5830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1869754990076160:0@lo:104: 00000100:00100000:1.0:1783137414.946573:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137414.946614:0:5830:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea600 going to sleep for 11 seconds 00000100:00100000:1.0:1783137414.946633:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990076160 00000100:00100000:1.0:1783137414.946638:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990076160 00000100:00100000:1.0:1783137414.946675:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137414.946681:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5830:x1869754990076160:12345-0@lo:104: 00010000:00010000:1.0:1783137414.946704:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67470c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137414.946743:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783137414.946749:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5830:x1869754990076160:12345-0@lo:104: Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137414.946756:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137414.946814:0:5830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1869754990076160:0@lo:104: 00010000:00010000:1.0:1783137414.946830:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.946911:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137414.946918:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67470c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.946925:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2172a00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137414.946928:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67470c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.946936:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67470c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137414.946943:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67470c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137414.946948:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783137414.946977:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67470c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.946982:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137414.947005:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67470c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947011:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67470c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947026:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137414.947028:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137414.947029:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137414.947040:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990076288:0@lo:103: 00000100:00100000:2.0:1783137414.947081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137414.947119:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990076288 00000100:00100000:2.0:1783137414.947123:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990076288 00010000:00010000:2.0:1783137414.947139:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2172600/0x88def104ac674713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67470c expref: 13 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137414.947157:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783137414.947163:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+13:3309:x1869754990076288:12345-0@lo:103: 00010000:00010000:2.0:1783137414.947172:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137414.947176:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2172600/0x88def104ac674713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67470c expref: 13 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947186:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2172600/0x88def104ac674713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac67470c expref: 13 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947197:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2172600/0x88def104ac674713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac67470c expref: 13 pid: 5807 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947208:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947226:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783137414.947237:0:5800:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001273771s 00010000:00010000:2.0:1783137414.947242:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947248:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947255:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947262:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947267:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2172400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137414.947271:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947278:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947291:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947298:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137414.947322:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+12:3309:x1869754990076288:12345-0@lo:103: Request processed in 159us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.947328:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1783137414.947383:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947390:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137414.947396:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2172400/0x88def104ac6747ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137414.947418:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990076288:0@lo:103: 00000100:00100000:2.0:1783137414.963645:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:6616:x1869754990076032:12345-0@lo:253: Request processed in 53864us (54017us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137414.963658:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783137414.963748:0:6616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:6616:1869754990076032:0@lo:253: 10000000:01000000:0.0:1783137414.963762:0:6616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783137414.963765:0:6616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783137414.963767:0:6616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783137414.963768:0:6616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137414.963769:0:6616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137414.963770:0:6616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137414.963772:0:6616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137414.963773:0:6616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137414.963775:0:6616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137414.963776:0:6616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137414.963778:0:6616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137414.963779:0:6616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783137414.963820:0:6616:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783137414.978774:0:6616:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137414.979110:0:6616:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137414.979332:0:6616:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137414.979897:0:6616:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137414.980177:0:6616:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137414.980453:0:6616:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783137414.981324:0:6616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1783137415.356458:0:6616:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783137415.356467:0:6616:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783137415.356513:0:6616:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783137415.356580:0:6616:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.136@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783137415.356594:0:6616:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783137415.356622:0:6616:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1783137415.655147:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783137415.853323:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783137415.853340:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97099cc6e000 from 21 10000000:01000000:0.0:1783137415.853345:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783137415.853400:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137415.853411:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137415.853422:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137415.853444:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990076416:0@lo:101: 00000100:00100000:0.0:1783137415.853503:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137415.853718:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709879eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137415.856109:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990076416 00000100:00100000:3.0:1783137415.856120:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990076416 00000100:00100000:3.0:1783137415.856178:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783137415.856188:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:5811:x1869754990076416:12345-0@lo:101: 00010000:00010000:3.0:1783137415.856338:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137415.856485:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6747b4 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137415.856580:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6747b4 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137415.856594:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6747b4 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137415.856603:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981488800, rc 0) 00000100:00100000:3.0:1783137415.856893:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990076416:12345-0@lo:101: Request processed in 706us (3388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137415.856901:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783137415.857591:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990076416:0@lo:101: 00010000:00010000:0.0:1783137415.857611:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137415.857621:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137415.857685:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990076544:0@lo:501: 00000100:00100000:0.0:1783137415.857727:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137415.857824:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709879eb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137415.864106:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990076544 00000100:00100000:1.0:1783137415.864118:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990076544 00000100:00100000:1.0:1783137415.864167:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783137415.864177:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990076544:12345-0@lo:501: 00000100:00100000:1.0:1783137415.864869:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990076544:12345-0@lo:501: Request processed in 690us (7138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137415.864877:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783137415.874904:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990076544:0@lo:501: 00000100:00100000:0.0:1783137415.874973:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990076672:0@lo:503: 00000100:00100000:0.0:1783137415.875056:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137415.875134:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709879eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137415.878673:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990076672 00000100:00100000:3.0:1783137415.878686:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990076672 00000100:00100000:3.0:1783137415.878740:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783137415.878749:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990076672:12345-0@lo:503: 00000100:00100000:3.0:1783137415.880215:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990076672:12345-0@lo:503: Request processed in 1461us (5153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137415.880235:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783137415.880559:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990076672:0@lo:503: 00000100:00100000:2.0:1783137415.884279:0:6663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6663:1869754990076800:0@lo:502: 00000100:00100000:2.0:1783137415.884364:0:6663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137415.884402:0:6663:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098968ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137415.885109:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990076800 00000100:00100000:1.0:1783137415.885118:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990076800 00000100:00100000:1.0:1783137415.885175:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783137415.885184:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:6663:x1869754990076800:12345-0@lo:502: 00000100:00100000:2.0:1783137415.886841:0:6663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6663:1869754990076800:0@lo:502: 00000100:00100000:2.0:1783137415.886905:0:6663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6663:1869754990076928:0@lo:502: 00000100:00100000:2.0:1783137415.886950:0:6663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137415.886995:0:6663:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098968ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137415.887094:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990076928 00000100:00100000:3.0:1783137415.887099:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990076928 00000100:00100000:3.0:1783137415.887135:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783137415.887143:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:6663:x1869754990076928:12345-0@lo:502: 00000100:00100000:1.0:1783137415.887779:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+13:6663:x1869754990076800:12345-0@lo:502: Request processed in 1603us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137415.887789:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783137415.888315:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:6663:x1869754990076928:12345-0@lo:502: Request processed in 1171us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137415.888323:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783137415.897376:0:6663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6663:1869754990076928:0@lo:502: 00000040:00080000:2.0:1783137415.897494:0:6663:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1783137415.897593:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1783137415.897623:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783137415.897634:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137415.897646:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137415.897657:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783137415.897659:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff97099cc6e000 from 4 10000000:01000000:1.0:1783137415.897662:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783137415.897696:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137415.897704:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137415.897713:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137415.897732:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077056:0@lo:101: 00000100:00100000:1.0:1783137415.897789:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137415.897856:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137415.897890:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990077056 00000100:00100000:2.0:1783137415.897896:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990077056 00000100:00100000:2.0:1783137415.898497:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783137415.898517:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990077056:12345-0@lo:101: 00010000:00010000:2.0:1783137415.898530:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137415.898546:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6747c2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137415.898569:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6747c2 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137415.898579:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6747c2 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137415.898587:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2044600, rc 0) 00000100:00100000:2.0:1783137415.898687:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990077056:12345-0@lo:101: Request processed in 173us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137415.898693:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783137415.903607:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077056:0@lo:101: 00010000:00010000:3.0:1783137415.903635:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137415.903647:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137415.903725:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986662d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077184:0@lo:256: 00000100:00100000:3.0:1783137415.903781:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137415.903868:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab290180 going to sleep for 11 seconds 00000100:00100000:1.0:1783137415.908055:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990077184 00000100:00100000:1.0:1783137415.908068:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990077184 00000100:00100000:1.0:1783137415.908135:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783137415.908145:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990077184:12345-0@lo:256: 20000000:01000000:1.0:1783137415.908168:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783137415.908188:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783137415.908191:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1783137415.908316:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990077184:12345-0@lo:256: Request processed in 172us (4533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137415.908339:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783137415.908671:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986662d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077184:0@lo:256: 10000000:01000000:3.0:1783137415.908723:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783137415.908732:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137415.908743:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137415.908752:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783137415.908758:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1783137415.908761:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783137415.908788:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137415.908809:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137415.908818:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137415.908835:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986662d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077312:0@lo:101: 00000100:00100000:3.0:1783137415.908868:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137415.908902:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab290180 going to sleep for 11 seconds 00000100:00100000:2.0:1783137415.909303:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990077312 00000100:00100000:2.0:1783137415.909309:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990077312 00000100:00100000:2.0:1783137415.909354:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783137415.909362:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990077312:12345-0@lo:101: 00010000:00010000:2.0:1783137415.909372:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137415.909385:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6747d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137415.909406:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6747d0 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137415.909486:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6747d0 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137415.909496:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2045a00, rc 0) 00000100:00100000:2.0:1783137415.909548:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990077312:12345-0@lo:101: Request processed in 187us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137415.909555:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783137415.909617:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986662d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077312:0@lo:101: 00010000:00010000:0.0:1783137415.909630:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137415.909638:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137415.909687:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077440:0@lo:501: 00000100:00100000:0.0:1783137415.909715:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137415.909739:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709879ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137415.909784:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990077440 00000100:00100000:2.0:1783137415.909804:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990077440 00000100:00100000:2.0:1783137415.909832:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783137415.909839:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990077440:12345-0@lo:501: 00000100:00100000:2.0:1783137415.910077:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990077440:12345-0@lo:501: Request processed in 238us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137415.910085:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783137415.910115:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077440:0@lo:501: 00000100:00100000:0.0:1783137415.910141:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077568:0@lo:503: 00000100:00100000:0.0:1783137415.910174:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137415.910201:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709879ebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137415.910249:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990077568 00000100:00100000:1.0:1783137415.910253:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990077568 00000100:00100000:1.0:1783137415.910280:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137415.910287:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990077568:12345-0@lo:503: 00000100:00100000:1.0:1783137415.910499:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990077568:12345-0@lo:503: Request processed in 212us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137415.910506:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783137415.910643:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990077568:0@lo:503: 00000100:00100000:0.0:1783137415.911110:0:6664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6664:1869754990077696:0@lo:502: 00000100:00100000:0.0:1783137415.911141:0:6664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137415.911166:0:6664:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709879eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1783137415.911207:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990077696 00000100:00100000:3.0:1783137415.911211:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990077696 00000100:00100000:3.0:1783137415.911240:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783137415.911247:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:6664:x1869754990077696:12345-0@lo:502: 00000100:00100000:3.0:1783137415.911626:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:6664:x1869754990077696:12345-0@lo:502: Request processed in 377us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137415.911632:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783137415.911763:0:6664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6664:1869754990077696:0@lo:502: 00000020:01000000:0.0:1783137415.911785:0:6664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783137415.911807:0:6664:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783137415.911815:0:6664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137415.911817:0:6664:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783137415.911822:0:6664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783137415.911832:0:6664:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.136@tcp to nid 0x20000c0a8cb88 (192.168.203.136@tcp) 00000020:01000000:0.0:1783137415.911852:0:6664:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783137415.911855:0:6664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783137415.911868:0:6664:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9709bf1f0000) 00000020:00000080:0.0:1783137415.911885:0:6664:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1783137415.911890:0:6664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783137415.911959:0:6664:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783137415.911964:0:6664:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783137415.911969:0:6664:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac6747e5 00010000:00080000:0.0:1783137415.911995:0:6664:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9709886ee000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.136@tcp at head 00010000:00010000:0.0:1783137415.912190:0:6664:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1783137416.061694:0:6664:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783137416.061716:0:6664:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783137416.062297:0:6664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783137416.062573:0:6664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783137416.062624:0:6664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1783137416.062679:0:6664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783137416.065705:0:6666:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783137416.065712:0:6666:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783137416.066613:0:6664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783137416.066626:0:6664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783137416.066658:0:6664:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783137416.066678:0:6664:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac6747ec 00000100:00080000:1.0:1783137416.066687:0:6664:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783137416.066693:0:6664:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9709886ee000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:1.0:1783137416.066724:0:6664:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bd921c00 x1869754990077824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783137416.066783:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990077824:0@lo:8: 00000100:00100000:0.0:1783137416.066884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137416.067071:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990077824 00000100:00100000:2.0:1783137416.067079:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990077824 00000100:00100000:2.0:1783137416.067108:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137416.067115:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1869754990077824:12345-0@lo:8: 00010000:00080000:2.0:1783137416.067138:0:6618:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1783137416.067164:0:6618:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac6747f3 00002000:00100000:2.0:1783137416.067191:0:6618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9709b7c9c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113655 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783137416.067195:0:6618:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1783137416.067199:0:6618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1783137416.067307:0:6618:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783137416.067451:0:6618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783137416.067474:0:6618:0:(import.c:65:import_set_state_nolock()) ffff9709b7c9d800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783137416.067779:0:6664:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783137416.067864:0:6664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137416.067869:0:6664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137416.067871:0:6664:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783137416.067875:0:6664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137416.067878:0:6664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137416.067880:0:6664:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783137416.067883:0:6664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783137416.067884:0:6664:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783137416.067910:0:6664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6664:1869754990077952:0@lo:502: 00000100:00100000:1.0:1783137416.067970:0:6664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137416.068000:0:6664:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783137416.068018:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990077952 00000100:00100000:1.0:1783137416.068022:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990077952 00000100:00100000:1.0:1783137416.068050:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783137416.068056:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:6664:x1869754990077952:12345-0@lo:502: 00000100:00100000:1.0:1783137416.068525:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:6664:x1869754990077952:12345-0@lo:502: Request processed in 466us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137416.068533:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783137416.068601:0:6664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6664:1869754990077952:0@lo:502: 00000020:01000000:1.0:1783137416.068626:0:6664:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137416.068631:0:6664:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137416.068633:0:6664:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783137416.068637:0:6664:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1783137416.068844:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1783137416.068858:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783137416.068867:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.068877:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137416.068886:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783137416.068889:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97099cc6e000 from 1 10000000:01000000:1.0:1783137416.068891:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137416.068914:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.068922:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.068939:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137416.068953:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990078080:0@lo:101: 00000100:00100000:1.0:1783137416.068983:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137416.069002:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69a240 going to sleep for 11 seconds 00000100:00100000:3.0:1783137416.070474:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990078208:0@lo:400: 00000100:00100000:3.0:1783137416.070529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137416.070558:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137416.070564:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990078336:0@lo:400: 00000100:00100000:3.0:1783137416.070585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137416.070617:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990078208 00000100:00100000:3.0:1783137416.070623:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990078208 00000100:00100000:3.0:1783137416.070657:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990078336 00000100:00100000:3.0:1783137416.070667:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990078336 00000100:00100000:3.0:1783137416.070696:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783137416.070703:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990078208:12345-0@lo:400: 00000100:00100000:3.0:1783137416.070744:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990078208:12345-0@lo:400: Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137416.070751:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783137416.070764:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783137416.070769:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990078336:12345-0@lo:400: 00000100:00100000:3.0:1783137416.070804:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990078336:12345-0@lo:400: Request processed in 21us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137416.070810:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783137416.070841:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff970986661c00 x1869754990078336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137416.070851:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990078336:0@lo:400: 00010000:00080000:3.0:1783137416.070860:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff970986661180 x1869754990078208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137416.070868:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990078208:0@lo:400: 00000100:00100000:3.0:1783137416.071020:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990078080 00000100:00100000:3.0:1783137416.071024:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990078080 00000100:00100000:3.0:1783137416.071045:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783137416.071051:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990078080:12345-0@lo:101: 00010000:00010000:3.0:1783137416.071061:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137416.071076:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6747fa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137416.071097:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6747fa expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137416.071114:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6747fa expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137416.071123:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981489800, rc 0) 00000100:00100000:3.0:1783137416.071155:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990078080:12345-0@lo:101: Request processed in 103us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137416.071161:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783137416.071279:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869754990077824:12345-0@lo:8: Request processed in 4161us (4393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137416.071288:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783137416.072023:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137416.072053:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990078080:0@lo:101: 00010000:00010000:1.0:1783137416.072069:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.072079:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137416.072132:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990078464:0@lo:501: 00000100:00100000:1.0:1783137416.072168:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137416.072204:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783137416.072220:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990078464 00000100:00100000:1.0:1783137416.072224:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990078464 00000100:00100000:1.0:1783137416.072252:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783137416.072259:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990078464:12345-0@lo:501: 00000100:00100000:1.0:1783137416.072516:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990078464:12345-0@lo:501: Request processed in 256us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137416.072522:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783137416.072557:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990078464:0@lo:501: 00000100:00100000:1.0:1783137416.072581:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990078592:0@lo:503: 00000100:00100000:1.0:1783137416.072623:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137416.072637:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783137416.072647:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990078592 00000100:00100000:1.0:1783137416.072651:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990078592 00000100:00100000:1.0:1783137416.072670:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783137416.072675:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990078592:12345-0@lo:503: 00000100:00100000:1.0:1783137416.072960:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990078592:12345-0@lo:503: Request processed in 283us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137416.072966:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783137416.073002:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990078592:0@lo:503: 00010000:00080000:0.0:1783137416.073258:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd921c00 x1869754990077824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783137426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137416.073270:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783137416.073277:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783137416.073284:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783137416.073290:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783137416.073294:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709886ee000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783137416.073313:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783137416.073319:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990077824:0@lo:8: 00000004:00080000:1.0:1783137416.074689:0:6666:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783137416.074855:0:6666:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 171972062764ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783137416.074957:0:6669:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6669:1869754990078720:0@lo:502: 00000100:00100000:1.0:1783137416.075026:0:6669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137416.075057:0:6669:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137416.075479:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990078720 00000100:00100000:0.0:1783137416.075491:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990078720 00000100:00100000:0.0:1783137416.075526:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783137416.075534:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:6669:x1869754990078720:12345-0@lo:502: 00000100:00100000:0.0:1783137416.075726:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:6669:x1869754990078720:12345-0@lo:502: Request processed in 192us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137416.075733:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783137416.080000:0:6669:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6669:1869754990078720:0@lo:502: 00000020:01000000:1.0:1783137416.080044:0:6669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137416.080054:0:6669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137416.082385:0:6669:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783137416.082404:0:6669:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97099cc6e000 00000020:00000080:1.0:1783137416.082408:0:6669:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783137416.082456:0:6669:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6669:1869754990078848:0@lo:502: 00000100:00100000:1.0:1783137416.082533:0:6669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137416.082580:0:6669:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1783137416.082685:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990078848 00000100:00100000:3.0:1783137416.082693:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990078848 00000100:00100000:3.0:1783137416.082743:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783137416.082752:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+15:6669:x1869754990078848:12345-0@lo:502: 00000100:00100000:3.0:1783137416.082970:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+15:6669:x1869754990078848:12345-0@lo:502: Request processed in 219us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137416.082977:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783137416.083027:0:6669:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd923b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:6669:1869754990078848:0@lo:502: 00000020:01000000:3.0:1783137416.083065:0:6669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137416.083070:0:6669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137416.083072:0:6669:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783137416.083075:0:6669:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783137416.083274:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783137416.083293:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137416.083304:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.083320:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137416.083339:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783137416.083341:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9709873db380 from 1 10000000:01000000:1.0:1783137416.083344:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783137416.083368:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.083376:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.083384:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137416.083397:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd923800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990078976:0@lo:101: 00000100:00100000:1.0:1783137416.083425:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137416.083455:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea600 going to sleep for 11 seconds 00000100:00100000:1.0:1783137416.083470:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990078976 00000100:00100000:1.0:1783137416.083474:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990078976 00000100:00100000:1.0:1783137416.083495:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783137416.083501:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990078976:12345-0@lo:101: 00010000:00010000:1.0:1783137416.083509:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137416.083520:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674808 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.083540:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674808 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.083561:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674808 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.083568:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2172600, rc 0) 00000100:00100000:1.0:1783137416.083596:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990078976:12345-0@lo:101: Request processed in 94us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137416.083602:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783137416.083630:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd923800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990078976:0@lo:101: 00010000:00010000:1.0:1783137416.083640:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.083648:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137416.083682:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd923800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990079104:0@lo:501: 00000100:00100000:1.0:1783137416.083705:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137416.083717:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea600 going to sleep for 11 seconds 00000100:00100000:1.0:1783137416.083727:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990079104 00000100:00100000:1.0:1783137416.083729:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990079104 00000100:00100000:1.0:1783137416.083746:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783137416.083751:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990079104:12345-0@lo:501: 00000100:00100000:1.0:1783137416.083966:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990079104:12345-0@lo:501: Request processed in 213us (258us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783137416.083973:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783137416.084000:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd923800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990079104:0@lo:501: 10000000:01000000:1.0:1783137416.084017:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783137416.084028:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137416.084035:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783137416.134963:0:6667:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783137416.134994:0:6667:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6667:1869754990079360:0@lo:7: 00000100:00100000:2.0:1783137416.135071:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137416.135124:0:6667:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a21240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137416.135147:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990079232:0@lo:13: 00000100:00100000:2.0:1783137416.135172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137416.135214:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990079232 00000100:00100000:2.0:1783137416.135222:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990079232 00000100:00100000:2.0:1783137416.135266:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137416.135274:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869754990079232:12345-0@lo:13: 00002000:00000024:2.0:1783137416.135304:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1783137416.135358:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869754990079232:12345-0@lo:13: Request processed in 83us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137416.135365:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783137416.135441:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783137416.135469:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd916680 x1869754990079232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137416.135488:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990079232:0@lo:13: 00000100:00100000:1.0:1783137416.135774:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990079360 00000100:00100000:1.0:1783137416.135778:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990079360 00000100:00100000:1.0:1783137416.135827:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137416.135834:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6667:x1869754990079360:12345-0@lo:7: 00002000:00080000:0.0:1783137416.156117:0:6620:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1783137416.156125:0:6620:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783137416.156210:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6667:x1869754990079360:12345-0@lo:7: Request processed in 20373us (21135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137416.156222:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783137416.164997:0:6667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd914a80 x1869754990079360/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783137432 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137416.165016:0:6667:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6667:1869754990079360:0@lo:7: 00000004:00080000:2.0:1783137416.165030:0:6667:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783137416.165077:0:6667:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6667:1869754990079488:0@lo:5: 00000100:00100000:2.0:1783137416.165128:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137416.165166:0:6667:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a21240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137416.165182:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990079488 00000100:00100000:2.0:1783137416.165188:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990079488 00000100:00100000:2.0:1783137416.165232:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137416.165248:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6667:x1869754990079488:12345-0@lo:5: 00002000:00080000:2.0:1783137416.165290:0:6618:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783137416.165294:0:6618:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783137416.165788:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6667:x1869754990079488:12345-0@lo:5: Request processed in 540us (658us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783137416.165816:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783137416.165853:0:6667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd914a80 x1869754990079488/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137432 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137416.165865:0:6667:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6667:1869754990079488:0@lo:5: 00000004:00080000:2.0:1783137416.165874:0:6667:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783137416.165898:0:6667:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6667:1869754990079616:0@lo:700: 00000100:00100000:2.0:1783137416.165924:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137416.165942:0:6667:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a21240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137416.165973:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990079616 00000100:00100000:2.0:1783137416.165977:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990079616 00000100:00100000:2.0:1783137416.166001:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137416.166008:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6667:x1869754990079616:12345-0@lo:700: 00000100:00100000:2.0:1783137416.166033:0:6627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6627:1869754990079744:0@lo:700: 00000100:00100000:2.0:1783137416.166142:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137416.166161:0:6627:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a21840 going to sleep for 11 seconds 00000100:00100000:2.0:1783137416.170681:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990079744 00000100:00100000:2.0:1783137416.170696:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990079744 00000100:00100000:2.0:1783137416.170755:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137416.170765:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6627:x1869754990079744:12345-0@lo:700: 00000004:00080000:1.0:1783137416.221105:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1783137416.241621:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1783137416.246941:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6627:x1869754990079744:12345-0@lo:700: Request processed in 76169us (80790us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137416.246968:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783137416.247167:0:6627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd914e00 x1869754990079744/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783137432 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137416.247183:0:6627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6627:1869754990079744:0@lo:700: 40000000:02000000:1.0:1783137416.247196:0:6627:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1783137416.375485:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1783137416.375497:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783137416.378042:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6667:x1869754990079616:12345-0@lo:700: Request processed in 212026us (212109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137416.378056:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783137416.378111:0:6667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd917100 x1869754990079616/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783137432 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137416.378123:0:6667:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783137416.378139:0:6667:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6667:1869754990079616:0@lo:700: 00000004:02000040:2.0:1783137416.419481:0:6667:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1783137416.424171:0:6667:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6667:1869754990079872:0@lo:5: 00000100:00100000:2.0:1783137416.424619:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137416.424949:0:6667:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137416.425031:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990079872 00000100:00100000:0.0:1783137416.425039:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990079872 00000100:00100000:0.0:1783137416.425450:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137416.425461:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6667:x1869754990079872:12345-0@lo:5: 00002000:00080000:2.0:1783137416.435277:0:6620:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1783137416.435296:0:6620:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1783137416.448284:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6667:x1869754990079872:12345-0@lo:5: Request processed in 22819us (23658us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783137416.448299:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783137416.448457:0:6667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd917100 x1869754990079872/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137432 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137416.448473:0:6667:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6667:1869754990079872:0@lo:5: 00000004:00080000:2.0:1783137416.448487:0:6667:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1783137416.689410:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137417.702957:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137418.728925:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137419.752251:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137420.778283:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137421.223006:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990080000:0@lo:13: 00000100:00100000:2.0:1783137421.223070:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137421.223140:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990080000 00000100:00100000:2.0:1783137421.223147:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990080000 00000100:00100000:2.0:1783137421.223192:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137421.223201:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990080000:12345-0@lo:13: 00002000:00000024:2.0:1783137421.223241:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137421.223294:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990080000:12345-0@lo:13: Request processed in 93us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137421.223301:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783137421.223320:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783137421.223347:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd916d80 x1869754990080000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137421.223364:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990080000:0@lo:13: 00000100:00100000:2.0:1783137421.224605:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990080256:0@lo:400: 00000100:00100000:2.0:1783137421.224646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137421.224673:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137421.224678:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990080128:0@lo:400: 00000100:00100000:2.0:1783137421.224705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137421.224737:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990080256 00000100:00100000:2.0:1783137421.224742:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990080256 00000100:00100000:2.0:1783137421.224774:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137421.224781:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990080256:12345-0@lo:400: 00000100:00100000:2.0:1783137421.224835:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990080256:12345-0@lo:400: Request processed in 54us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137421.224842:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137421.224860:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990080128 00000100:00100000:2.0:1783137421.224864:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990080128 00000100:00100000:2.0:1783137421.224885:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783137421.224891:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:3307:x1869754990080128:12345-0@lo:400: 00000100:00100000:2.0:1783137421.224918:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:3307:x1869754990080128:12345-0@lo:400: Request processed in 27us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137421.224932:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783137421.224964:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990080384:0@lo:400: 00000100:00100000:2.0:1783137421.224987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137421.225014:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990080384 00000100:00100000:2.0:1783137421.225017:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990080384 00000100:00100000:2.0:1783137421.225044:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137421.225050:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990080384:12345-0@lo:400: 00000100:00100000:2.0:1783137421.225082:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990080384:12345-0@lo:400: Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137421.225087:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1783137421.225101:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783137421.225122:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd914380 x1869754990080384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137421.225134:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990080384:0@lo:400: 00000100:00100000:2.0:1783137421.225158:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990080128:0@lo:400: 00010000:00080000:2.0:1783137421.225168:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd916300 x1869754990080256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137421.225176:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990080256:0@lo:400: 00010000:00010000:0.0:1783137421.799583:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783137421.831221:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:1.0:1783137422.643377:0:6990:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783137422.836389:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137423.847197:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137424.874731:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137425.894929:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137426.343054:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137426.343079:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990080512:0@lo:13: 00000100:00100000:1.0:1783137426.343151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137426.343333:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990080512 00000100:00100000:2.0:1783137426.343341:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990080512 00000100:00100000:2.0:1783137426.343402:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137426.343412:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990080512:12345-0@lo:13: 00002000:00000024:2.0:1783137426.343458:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137426.343517:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990080512:12345-0@lo:13: Request processed in 106us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137426.343536:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783137426.343578:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd916300 x1869754990080512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137426.343589:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783137426.343608:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990080512:0@lo:13: 00000100:00080000:1.0:1783137426.343663:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137426.343991:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990080896:0@lo:400: 00000100:00100000:1.0:1783137426.344021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137426.344082:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990080768:0@lo:400: 00000100:00100000:2.0:1783137426.344109:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137426.344127:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137426.344132:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990080640:0@lo:400: 00000100:00100000:2.0:1783137426.344170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137426.344216:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990080896 00000100:00100000:2.0:1783137426.344219:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990080896 00000100:00100000:2.0:1783137426.344252:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990080768 00000100:00100000:2.0:1783137426.344255:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990080768 00000100:00100000:2.0:1783137426.344269:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783137426.344275:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990080896:12345-0@lo:400: 00000100:00100000:3.0:1783137426.344335:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990080640 00000100:00100000:3.0:1783137426.344339:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990080640 00000100:00100000:3.0:1783137426.344364:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783137426.344370:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:3307:x1869754990080640:12345-0@lo:400: 00000100:00100000:3.0:1783137426.344404:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:3307:x1869754990080640:12345-0@lo:400: Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137426.344438:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783137426.344487:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990080640:0@lo:400: 00000100:00100000:0.0:1783137426.347353:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783137426.347373:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783137426.347446:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783137426.347473:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783137426.347487:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990080768:12345-0@lo:400: 00000100:00100000:3.0:1783137426.347581:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990080768:12345-0@lo:400: Request processed in 97us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137426.347588:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1783137426.347616:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783137426.347831:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff970986661c00 x1869754990080768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137426.347846:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990080768:0@lo:400: 00000100:00100000:2.0:1783137426.348084:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990080896:12345-0@lo:400: Request processed in 3806us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137426.348092:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783137426.355919:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff970986663100 x1869754990080896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137426.356022:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990080896:0@lo:400: 00010000:00010000:0.0:1783137426.924585:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137427.943058:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137428.967002:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137429.993297:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137431.015011:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137431.463991:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990081024:0@lo:400: 00000100:00100000:0.0:1783137431.464068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137431.464132:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990081152:0@lo:400: 00000100:00100000:0.0:1783137431.464174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137431.464197:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137431.464204:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990081280:0@lo:400: 00000100:00100000:0.0:1783137431.464226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137431.464257:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990081152 00000100:00100000:0.0:1783137431.464265:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990081152 00000100:00100000:0.0:1783137431.464302:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990081280 00000100:00100000:0.0:1783137431.464305:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990081280 00000100:00100000:0.0:1783137431.464336:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783137431.464344:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990081152:12345-0@lo:400: 00000100:00100000:0.0:1783137431.464396:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990081152:12345-0@lo:400: Request processed in 52us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137431.464403:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783137431.464420:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137431.464426:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990081280:12345-0@lo:400: 00000100:00100000:0.0:1783137431.464452:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990081280:12345-0@lo:400: Request processed in 26us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137431.464458:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1783137431.464477:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783137431.464505:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff970986660000 x1869754990081280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137431.464519:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990081280:0@lo:400: 00010000:00080000:0.0:1783137431.464545:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff970986662680 x1869754990081152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137431.464554:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990081152:0@lo:400: 00000100:00100000:3.0:1783137431.464664:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990081408:0@lo:400: 00000100:00100000:3.0:1783137431.464701:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137431.464784:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990081408 00000100:00100000:0.0:1783137431.464789:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990081408 00000100:00100000:0.0:1783137431.464849:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137431.464856:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990081408:12345-0@lo:400: 00000100:00100000:0.0:1783137431.464901:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990081408:12345-0@lo:400: Request processed in 46us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137431.464908:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783137431.464937:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff970986660a80 x1869754990081408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137431.465056:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990081408:0@lo:400: 00000100:00080000:3.0:1783137431.465286:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137431.465410:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990081024 00000100:00100000:2.0:1783137431.465414:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990081024 00000100:00100000:2.0:1783137431.465445:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783137431.465452:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+16:3309:x1869754990081024:12345-0@lo:400: 00000100:00100000:2.0:1783137431.465497:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+16:3309:x1869754990081024:12345-0@lo:400: Request processed in 46us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137431.465503:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783137431.465557:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990081024:0@lo:400: 00000100:00100000:0.0:1783137431.466023:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137431.466034:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990081536:0@lo:13: 00000100:00100000:0.0:1783137431.466065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137431.466176:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990081536 00000100:00100000:2.0:1783137431.466181:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990081536 00000100:00100000:2.0:1783137431.466215:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137431.466223:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990081536:12345-0@lo:13: 00002000:00000024:2.0:1783137431.466249:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137431.466293:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990081536:12345-0@lo:13: Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137431.466300:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783137431.466838:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bc35ca80 x1869754990081536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137431.466855:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990081536:0@lo:13: 00010000:00010000:0.0:1783137432.038887:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137433.063962:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783137433.422122:0:7517:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783137433.422545:0:7517:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1783137433.422716:0:7517:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9709b7c81800 00000020:01000004:2.0:1783137433.422749:0:7517:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783137433.422763:0:7517:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1783137433.422787:0:7517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9709afe399c0) 00000020:00000080:2.0:1783137433.422821:0:7517:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783137433.441221:0:7517:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783137433.441454:0:7517:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783137433.480697:0:7517:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783137433.503624:0:7517:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783137433.503662:0:7517:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783137433.503719:0:7517:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783137433.506086:0:7517:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783137433.506421:0:7517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783137433.506434:0:7517:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783137433.506444:0:7517:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88def104ac67481d 00000020:01000004:3.0:1783137433.506451:0:7517:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783137433.506472:0:7517:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.136@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783137433.506476:0:7517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783137433.506481:0:7517:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783137433.506500:0:7517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783137433.506515:0:7517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783137433.536727:0:7517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783137433.536763:0:7517:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.136@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783137433.536768:0:7517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783137433.536770:0:7517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783137433.536771:0:7517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137433.536772:0:7517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137433.536773:0:7517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137433.536775:0:7517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137433.536776:0:7517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137433.536778:0:7517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783137433.536779:0:7517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783137433.536781:0:7517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137433.536782:0:7517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783137433.536786:0:7517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783137433.536788:0:7517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783137433.536828:0:7517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783137433.536830:0:7517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137433.536830:0:7517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137433.536831:0:7517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137433.536833:0:7517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137433.536834:0:7517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137433.536835:0:7517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783137433.536836:0:7517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783137433.536837:0:7517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137433.536838:0:7517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783137433.537905:0:7517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783137433.537929:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990081664:0@lo:253: 00000100:00100000:1.0:1783137433.538002:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137433.538049:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bc952480 going to sleep for 11 seconds 00000100:00100000:3.0:1783137433.538288:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990081664 00000100:00100000:3.0:1783137433.538297:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990081664 00000100:00100000:3.0:1783137433.538352:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783137433.538361:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:7517:x1869754990081664:12345-0@lo:253: 20000000:01000000:3.0:1783137433.538390:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783137433.538395:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1783137433.538401:0:5807:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1783137433.538403:0:5807:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1783137433.539651:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783137433.540389:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1783137433.540408:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1783137433.540457:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1783137433.540467:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1783137433.540498:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1783137433.540560:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1783137433.541477:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1783137433.541499:0:5807:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.136@tcp 20000000:01000000:0.0:1783137433.541501:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:0.0:1783137433.541533:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1783137433.541540:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783137433.541598:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1783137433.541607:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:0.0:1783137433.541640:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1783137433.541649:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783137433.541696:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1783137433.541966:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1783137433.542721:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1783137433.542742:0:5807:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.136@tcp 20000000:01000000:0.0:1783137433.542744:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.136@tcp (null) (null) (null) 00000040:00080000:0.0:1783137433.542781:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1783137433.542825:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783137433.545054:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1783137433.545080:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.136@tcp (null) (null) 00000040:00080000:0.0:1783137433.546091:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1783137433.546108:0:5807:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783137433.546212:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1783137433.546254:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1783137433.546275:0:5807:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783137433.546277:0:5807:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783137433.546281:0:5807:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783137433.546293:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783137433.546296:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1783137433.546336:0:5807:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783137433.546339:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783137433.553734:0:7519:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1783137433.553882:0:7519:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1783137433.553918:0:7519:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1783137433.554353:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1783137433.554398:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1783137433.554467:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1783137433.554480:0:5807:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783137433.554482:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783137433.557493:0:7520:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1783137433.557784:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1783137433.557882:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1783137433.557954:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1783137433.557971:0:5807:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783137433.557973:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783137433.558584:0:7521:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1783137433.558633:0:7521:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1783137433.558705:0:7521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1783137433.568469:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1783137433.568517:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1783137433.568588:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1783137433.568602:0:5807:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783137433.568605:0:5807:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783137433.573054:0:7522:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1783137433.573156:0:7522:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1783137433.573212:0:7522:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1783137433.574457:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1783137433.574506:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1783137433.574538:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1783137433.574556:0:5807:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1783137433.574559:0:5807:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1783137433.574576:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783137433.574594:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.574610:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970981488c00/0x88def104ac674767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674760 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.574616:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67478a expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.574622:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6747b4 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.574628:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6747d0 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.574635:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674808 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.574641:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.574676:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac674808 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.574688:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac674808 expref: 16 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.574701:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990081792:0@lo:104: 00000100:00100000:2.0:1783137433.575176:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137433.575261:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6747d0 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.575284:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6747d0 expref: 16 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.575294:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990081920:0@lo:104: 00010000:00010000:2.0:1783137433.575322:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6747b4 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.575329:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6747b4 expref: 16 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.575337:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990082048:0@lo:104: 00010000:00010000:2.0:1783137433.575374:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac67478a expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.575381:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac67478a expref: 16 pid: 5809 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.575389:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990082176:0@lo:104: 00010000:00010000:2.0:1783137433.575412:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970981488c00/0x88def104ac674767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac674760 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.575420:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff970981488c00/0x88def104ac674767 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac674760 expref: 16 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.575428:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990082304:0@lo:104: 00000100:00100000:2.0:1783137433.575445:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137433.575567:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783137433.575585:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.575648:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.575831:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137433.576094:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990081792 00000100:00100000:1.0:1783137433.576102:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990081792 00000100:00100000:1.0:1783137433.576146:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990081920 00000100:00100000:1.0:1783137433.576149:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990081920 00000100:00100000:1.0:1783137433.576160:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990082048 00000100:00100000:1.0:1783137433.576163:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990082048 00000100:00100000:1.0:1783137433.576179:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783137433.576186:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098b095c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+5:5807:x1869754990081792:12345-0@lo:104: 00010000:00010000:1.0:1783137433.576198:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.576297:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783137433.576304:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098b095c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+5:5807:x1869754990081792:12345-0@lo:104: Request processed in 118us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.576310:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783137433.576343:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783137433.576350:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:5807:x1869754990081920:12345-0@lo:104: 00010000:00010000:1.0:1783137433.576357:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.576390:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783137433.576395:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:5807:x1869754990081920:12345-0@lo:104: Request processed in 46us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.576400:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783137433.576411:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783137433.576417:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5807:x1869754990082048:12345-0@lo:104: 00010000:00010000:1.0:1783137433.576424:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.576463:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783137433.576470:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:5807:x1869754990082048:12345-0@lo:104: Request processed in 53us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.576475:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783137433.576600:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.576612:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990082176 00000100:00100000:0.0:1783137433.576616:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990082176 00000100:00100000:0.0:1783137433.576631:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990082304 00000100:00100000:0.0:1783137433.576633:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990082304 00000100:00100000:0.0:1783137433.576643:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137433.576648:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e4795b-54a4-4490-bb2a-864b21234c99+4:5807:x1869754990082176:12345-0@lo:104: 00010000:00010000:0.0:1783137433.576657:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.576686:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783137433.576690:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e4795b-54a4-4490-bb2a-864b21234c99+4:5807:x1869754990082176:12345-0@lo:104: Request processed in 43us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.576696:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137433.576707:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783137433.576712:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e4795b-54a4-4490-bb2a-864b21234c99+3:5807:x1869754990082304:12345-0@lo:104: 00010000:00010000:0.0:1783137433.576719:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.576781:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783137433.576785:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e4795b-54a4-4490-bb2a-864b21234c99+3:5807:x1869754990082304:12345-0@lo:104: Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.576811:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783137433.576827:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783137433.576832:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.576839:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2172400 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137433.576843:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.576853:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137433.576978:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137433.576983:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137433.577013:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577018:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137433.577036:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577042:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2172400/0x88def104ac674808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac67480f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577066:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783137433.577069:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577074:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970981488600 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137433.577076:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577155:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137433.577163:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137433.577168:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137433.577182:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577188:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137433.577192:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577198:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970981488600/0x88def104ac6747d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6747d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577207:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783137433.577210:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577223:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980030c00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137433.577226:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577231:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137433.577238:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137433.577243:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137433.577256:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577261:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137433.577279:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577286:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac6747b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6747bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577295:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783137433.577298:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577303:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970981489000 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137433.577306:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577321:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137433.577327:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137433.577331:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137433.577344:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577350:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137433.577355:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577361:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970981489000/0x88def104ac67478a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674791 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577369:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137433.577371:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577377:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2173000 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137433.577379:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577384:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137433.577389:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137433.577399:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137433.577411:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674760 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577416:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137433.577419:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674760 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577425:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674760 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674767 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.577444:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137433.577445:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137433.577447:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137433.577456:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137433.577467:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990082432:0@lo:103: 00000100:00100000:0.0:1783137433.577499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.577528:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990082944:0@lo:103: 00000100:00100000:0.0:1783137433.577547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.577565:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137433.577571:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990082560:0@lo:103: 00000100:00100000:0.0:1783137433.577589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.577614:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990082688:0@lo:103: 00000100:00100000:0.0:1783137433.577632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.577643:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137433.577648:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990082816:0@lo:103: 00000100:00100000:0.0:1783137433.577665:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.577697:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990082432 00000100:00100000:0.0:1783137433.577702:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990082432 00010000:00010000:0.0:1783137433.580246:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674808 expref: 17 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137433.580291:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990082944 00000100:00100000:0.0:1783137433.580298:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990082944 00010000:00010000:0.0:1783137433.580331:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970981488c00/0x88def104ac674767 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674760 expref: 18 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137433.580343:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990082560 00000100:00100000:0.0:1783137433.580346:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990082560 00010000:00010000:0.0:1783137433.580358:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6747d0 expref: 19 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137433.580368:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990082688 00000100:00100000:0.0:1783137433.580371:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990082688 00010000:00010000:0.0:1783137433.580401:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6747b4 expref: 20 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137433.580412:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990082816 00000100:00100000:0.0:1783137433.580415:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990082816 00010000:00010000:0.0:1783137433.580425:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67478a expref: 21 pid: 5809 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137433.580437:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137433.580444:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+21:3306:x1869754990082432:12345-0@lo:103: 00010000:00010000:0.0:1783137433.580457:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137433.580462:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674808 expref: 21 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.580472:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac674808 expref: 21 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.580495:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137433.580556:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+21:3306:x1869754990082432:12345-0@lo:103: Request processed in 111us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.580564:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137433.580581:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783137433.580587:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+20:3306:x1869754990082944:12345-0@lo:103: 00010000:00010000:0.0:1783137433.580595:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137433.580599:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970981488c00/0x88def104ac674767 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674760 expref: 20 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.580606:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970981488c00/0x88def104ac674767 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac674760 expref: 20 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.580615:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137433.580637:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+20:3306:x1869754990082944:12345-0@lo:103: Request processed in 50us (3088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.580642:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783137433.580653:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783137433.580659:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990082560:12345-0@lo:103: 00010000:00010000:0.0:1783137433.580665:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137433.580669:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6747d0 expref: 19 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.580677:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6747d0 expref: 19 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.580686:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137433.580715:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990082560:12345-0@lo:103: Request processed in 56us (3124us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.581218:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990082560:0@lo:103: 00000100:00100000:1.0:1783137433.581230:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990082432:0@lo:103: 00000100:00100000:1.0:1783137433.581236:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990082944:0@lo:103: 00000100:00100000:0.0:1783137433.582062:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783137433.582762:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137433.582776:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+18:3308:x1869754990082688:12345-0@lo:103: 00010000:00010000:0.0:1783137433.582809:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137433.582817:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6747b4 expref: 18 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.582829:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6747b4 expref: 18 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.582844:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137433.582995:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+18:3308:x1869754990082688:12345-0@lo:103: Request processed in 224us (5360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.583004:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137433.583021:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783137433.583028:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+17:3308:x1869754990082816:12345-0@lo:103: 00010000:00010000:0.0:1783137433.583035:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137433.583040:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67478a expref: 17 pid: 5809 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583048:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac67478a expref: 17 pid: 5809 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583058:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583066:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137433.583212:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990082688:0@lo:103: 00010000:00010000:0.0:1783137433.583273:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583282:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583288:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583295:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583300:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2045e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137433.583305:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583312:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583321:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.583330:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137433.583404:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+17:3308:x1869754990082816:12345-0@lo:103: Request processed in 376us (5737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.583410:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1783137433.583616:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2172600/0x88def104ac67480f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac674808 expref: 16 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.583639:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990081792:0@lo:104: 00010000:00010000:2.0:1783137433.583661:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2045a00/0x88def104ac6747d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6747d0 expref: 15 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.583669:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990081920:0@lo:104: 00010000:00010000:2.0:1783137433.583678:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488800/0x88def104ac6747bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6747b4 expref: 14 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.583686:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990082048:0@lo:104: 00010000:00010000:2.0:1783137433.583694:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2045000/0x88def104ac674791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac67478a expref: 13 pid: 5809 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.583700:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990082176:0@lo:104: 00010000:00010000:2.0:1783137433.583708:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488c00/0x88def104ac674767 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac674760 expref: 12 pid: 5808 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.583714:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5807:1869754990082304:0@lo:104: 00010000:00010000:2.0:1783137433.583733:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.583742:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.583747:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.583752:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2045e00/0x88def104ac674824 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783137433.583771:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783137433.590595:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990082816:0@lo:103: 00000100:00100000:3.0:1783137433.674097:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+11:7517:x1869754990081664:12345-0@lo:253: Request processed in 135728us (136085us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137433.674112:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783137433.674195:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990081664:0@lo:253: 10000000:01000000:1.0:1783137433.674209:0:7517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783137433.674213:0:7517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783137433.674215:0:7517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783137433.674216:0:7517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137433.674217:0:7517:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783137433.674219:0:7517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137433.674221:0:7517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137433.674222:0:7517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137433.674224:0:7517:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783137433.674225:0:7517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137433.674227:0:7517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783137433.674249:0:7517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9709b7c81800 from lustre-OST0001 10000000:01000000:1.0:1783137433.674272:0:7517:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783137433.674275:0:7517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783137433.674283:0:7517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9709873db380 local copy 10000000:01000000:1.0:1783137433.674287:0:7517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783137433.674320:0:7517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.674342:0:7517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.674352:0:7517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137433.674371:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083072:0@lo:101: 00000100:00100000:1.0:1783137433.674405:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137433.674487:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bc952f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137433.674526:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990083072 00000100:00100000:2.0:1783137433.674532:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990083072 00000100:00100000:2.0:1783137433.674609:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783137433.674618:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+11:7517:x1869754990083072:12345-0@lo:101: 00010000:00010000:2.0:1783137433.674631:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137433.674644:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2045e00/0x88def104ac674832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67482b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.674665:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2045e00/0x88def104ac674832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67482b expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.674676:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2045e00/0x88def104ac674832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67482b expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.674685:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2045e00, rc 0) 00000100:00100000:2.0:1783137433.674723:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083072:12345-0@lo:101: Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137433.674729:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783137433.674788:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083072:0@lo:101: 00010000:00010000:1.0:1783137433.674832:0:7517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.674840:0:7517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137433.674939:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083200:0@lo:501: 00000100:00100000:1.0:1783137433.674963:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137433.675255:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bc952f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137433.675315:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990083200 00000100:00100000:0.0:1783137433.675320:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990083200 00000100:00100000:0.0:1783137433.675342:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783137433.675349:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083200:12345-0@lo:501: 00000100:00100000:0.0:1783137433.675612:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083200:12345-0@lo:501: Request processed in 263us (647us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783137433.675620:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783137433.675720:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083200:0@lo:501: 10000000:01000000:1.0:1783137433.675734:0:7517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783137433.675761:0:7517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783137433.675767:0:7517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.675776:0:7517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.676000:0:7517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.676202:0:7517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783137433.676225:0:7517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9709b7c81800 10000000:01000000:0.0:1783137433.676229:0:7517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783137433.676234:0:7517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783137433.676237:0:7517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783137433.676241:0:7517:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783137433.676243:0:7517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783137433.676262:0:7517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.676270:0:7517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.676278:0:7517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137433.676291:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083328:0@lo:101: 00000100:00100000:0.0:1783137433.676320:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.676384:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0fe40 going to sleep for 11 seconds 00010000:00010000:2.0:1783137433.676414:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137433.676421:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.676429:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2172a00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137433.676432:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.676441:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137433.676455:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137433.676462:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783137433.676481:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.676487:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137433.676516:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.676523:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac67482b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x88def104ac674832 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.676536:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137433.676538:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137433.676539:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137433.676576:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137433.676587:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990083456:0@lo:103: 00000100:00100000:3.0:1783137433.676617:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137433.676706:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990083456 00000100:00100000:2.0:1783137433.676712:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990083456 00000100:00100000:2.0:1783137433.676750:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137433.676758:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+12:3306:x1869754990083456:12345-0@lo:103: 00010000:00010000:2.0:1783137433.676768:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137433.676780:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2045e00/0x88def104ac674832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac67482b expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.676829:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137433.676987:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990083456:0@lo:103: 00000100:00100000:2.0:1783137433.677028:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+11:3306:x1869754990083456:12345-0@lo:103: Request processed in 272us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137433.677036:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137433.677090:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990083328 00000100:00100000:1.0:1783137433.677095:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990083328 00000100:00100000:1.0:1783137433.677154:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783137433.677162:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+11:7517:x1869754990083328:12345-0@lo:101: 00010000:00010000:1.0:1783137433.677171:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137433.677183:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674839 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.677199:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674839 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.677207:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674839 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.677213:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2172600, rc 0) 00000100:00100000:1.0:1783137433.677251:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083328:12345-0@lo:101: Request processed in 89us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.677256:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783137433.677312:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083328:0@lo:101: 00010000:00010000:0.0:1783137433.677325:0:7517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.677332:0:7517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137433.677412:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083584:0@lo:501: 00000100:00100000:0.0:1783137433.677437:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.677501:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137433.677555:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990083584 00000100:00100000:2.0:1783137433.677559:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990083584 00000100:00100000:2.0:1783137433.677577:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783137433.677584:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083584:12345-0@lo:501: 00000100:00100000:2.0:1783137433.677871:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083584:12345-0@lo:501: Request processed in 287us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137433.677878:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783137433.678185:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083584:0@lo:501: 00000100:00100000:0.0:1783137433.678214:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083712:0@lo:503: 00000100:00100000:0.0:1783137433.678252:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.678305:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137433.678333:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990083712 00000100:00100000:2.0:1783137433.678336:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990083712 00000100:00100000:2.0:1783137433.678391:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783137433.678398:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083712:12345-0@lo:503: 00000100:00100000:2.0:1783137433.678541:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083712:12345-0@lo:503: Request processed in 142us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137433.678547:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783137433.678608:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083712:0@lo:503: 00000040:00080000:0.0:1783137433.678885:0:7517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783137433.678938:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083840:0@lo:502: 00000100:00100000:0.0:1783137433.678972:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.679254:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137433.679323:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990083840 00000100:00100000:1.0:1783137433.679328:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990083840 00000100:00100000:1.0:1783137433.679350:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783137433.679356:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083840:12345-0@lo:502: 00000100:00100000:1.0:1783137433.679503:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083840:12345-0@lo:502: Request processed in 145us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.679519:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783137433.679622:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083840:0@lo:502: 00000040:00080000:0.0:1783137433.680012:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783137433.680056:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783137433.680084:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783137433.680136:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783137433.680172:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783137433.680201:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783137433.680228:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083968:0@lo:502: 00000100:00100000:0.0:1783137433.680268:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.680340:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137433.680440:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990083968 00000100:00100000:3.0:1783137433.680445:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990083968 00000100:00100000:1.0:1783137433.680552:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783137433.680613:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083968:12345-0@lo:502: 00000100:00100000:0.0:1783137433.680757:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990083968:12345-0@lo:502: Request processed in 197us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.680769:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783137433.680895:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990083968:0@lo:502: 00000040:00080000:2.0:1783137433.680985:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783137433.680996:0:7517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1783137433.681485:0:7526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783137433.681492:0:7526:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1783137433.681498:0:7526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137433.681500:0:7526:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783137433.681506:0:7526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783137433.681527:0:7526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9709bd85cd40) 00000020:00000080:1.0:1783137433.681547:0:7526:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783137433.681553:0:7526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783137433.681619:0:7526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9709b7c81800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783137433.681626:0:7526:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783137433.681632:0:7526:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88def104ac67484e 00010000:00010000:0.0:1783137433.685349:0:7526:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1783137433.685612:0:7526:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1783137433.692507:0:7526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783137433.693211:0:7526:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1783137433.705644:0:7526:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1783137433.707422:0:7526:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1783137433.723561:0:7526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783137433.723574:0:7526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137433.723579:0:7526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137433.723582:0:7526:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783137433.723585:0:7526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137433.723589:0:7526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137433.723590:0:7526:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783137433.723593:0:7526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783137433.723595:0:7526:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783137433.723650:0:7526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137433.723653:0:7526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137433.723655:0:7526:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783137433.723658:0:7526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783137433.726105:0:7517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1783137433.726144:0:7517:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783137433.726164:0:7517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.726176:0:7517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137433.726185:0:7517:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709b7c81800 from 1 10000000:01000000:1.0:1783137433.726188:0:7517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137433.726222:0:7517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.726247:0:7517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137433.726257:0:7517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137433.726279:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084096:0@lo:101: 00000100:00100000:1.0:1783137433.726339:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137433.726383:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bc952cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137433.726502:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990084096 00000100:00100000:0.0:1783137433.726509:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990084096 00000100:00100000:0.0:1783137433.726558:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783137433.726567:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:7517:x1869754990084096:12345-0@lo:101: 00010000:00010000:0.0:1783137433.726579:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137433.726592:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674855 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.726614:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674855 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.726624:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674855 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.726631:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980030a00, rc 0) 00000100:00100000:0.0:1783137433.728326:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084096:12345-0@lo:101: Request processed in 1753us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.728337:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783137433.730325:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084096:0@lo:101: 00010000:00010000:0.0:1783137433.730353:0:7517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.730365:0:7517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137433.730473:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084224:0@lo:501: 00000100:00100000:0.0:1783137433.730524:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.730567:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0f000 going to sleep for 11 seconds 00000100:00100000:2.0:1783137433.736165:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990084224 00000100:00100000:2.0:1783137433.736178:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990084224 00000100:00100000:2.0:1783137433.736231:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783137433.736241:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084224:12345-0@lo:501: 00000100:00100000:2.0:1783137433.736526:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084224:12345-0@lo:501: Request processed in 285us (6000us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137433.736534:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783137433.738138:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084224:0@lo:501: 00000100:00100000:0.0:1783137433.738191:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084352:0@lo:503: 00000100:00100000:0.0:1783137433.738249:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.738292:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0f000 going to sleep for 11 seconds 00000100:00100000:3.0:1783137433.738949:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990084352 00000100:00100000:3.0:1783137433.738957:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990084352 00000100:00100000:3.0:1783137433.739057:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783137433.739067:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084352:12345-0@lo:503: 00000100:00100000:3.0:1783137433.739407:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084352:12345-0@lo:503: Request processed in 341us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137433.739415:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783137433.739467:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084352:0@lo:503: 00000040:00080000:3.0:1783137433.739718:0:7517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783137433.739774:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084480:0@lo:502: 00000100:00100000:3.0:1783137433.739828:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137433.739845:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709885ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1783137433.741636:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990084480 00000100:00100000:0.0:1783137433.741655:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990084480 00000100:00100000:0.0:1783137433.743199:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783137433.743217:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084480:12345-0@lo:502: 00000100:00100000:0.0:1783137433.743490:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084480:12345-0@lo:502: Request processed in 279us (3660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.743499:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783137433.743984:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084480:0@lo:502: 00000040:00080000:2.0:1783137433.744262:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783137433.744316:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783137433.744358:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084608:0@lo:502: 00000100:00100000:2.0:1783137433.744407:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137433.744446:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a300 going to sleep for 11 seconds 00000100:00100000:0.0:1783137433.744608:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990084608 00000100:00100000:0.0:1783137433.744615:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990084608 00000100:00100000:1.0:1783137433.744756:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783137433.744767:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084608:12345-0@lo:502: 00000100:00100000:1.0:1783137433.744968:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084608:12345-0@lo:502: Request processed in 203us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.744975:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783137433.745312:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084608:0@lo:502: 00000040:00080000:2.0:1783137433.745415:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783137433.745425:0:7517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783137433.746492:0:7530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137433.746502:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137433.746504:0:7530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783137433.746511:0:7530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9709b7c81800 00000020:00000080:3.0:1783137433.746513:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783137433.746533:0:7530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137433.746537:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137433.746538:0:7530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783137433.746541:0:7530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783137433.746955:0:7517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783137433.746981:0:7517:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783137433.747057:0:7517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.747068:0:7517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137433.747110:0:7517:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783137433.747113:0:7517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9709b7c81800 10000000:01000000:2.0:1783137433.747116:0:7517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9709b7c81800 10000000:01000000:2.0:1783137433.747131:0:7517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783137433.747136:0:7517:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9709b7c81800 from 1 10000000:01000000:2.0:1783137433.747139:0:7517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783137433.747169:0:7517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.747178:0:7517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.747187:0:7517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.747207:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084736:0@lo:101: 00000100:00100000:2.0:1783137433.747278:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137433.747317:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a300 going to sleep for 11 seconds 00000100:00100000:0.0:1783137433.747444:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990084736 00000100:00100000:0.0:1783137433.747458:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990084736 00000100:00100000:0.0:1783137433.747501:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783137433.747509:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990084736:12345-0@lo:101: 00010000:00010000:0.0:1783137433.747520:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137433.747541:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674863 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.747562:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674863 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.747571:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674863 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.747580:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980031800, rc 0) 00000100:00100000:0.0:1783137433.747624:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990084736:12345-0@lo:101: Request processed in 116us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.747631:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783137433.747849:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084736:0@lo:101: 00010000:00010000:2.0:1783137433.747964:0:7517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137433.747972:0:7517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.748131:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084864:0@lo:501: 00000100:00100000:2.0:1783137433.748159:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137433.748185:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137433.748236:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990084864 00000100:00100000:3.0:1783137433.748240:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990084864 00000100:00100000:3.0:1783137433.748272:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783137433.748279:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990084864:12345-0@lo:501: 00000100:00100000:3.0:1783137433.748488:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990084864:12345-0@lo:501: Request processed in 208us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137433.748495:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783137433.749183:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084864:0@lo:501: 00000100:00100000:2.0:1783137433.749218:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084992:0@lo:503: 00000100:00100000:2.0:1783137433.749266:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137433.749289:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a300 going to sleep for 11 seconds 00000100:00100000:1.0:1783137433.749394:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990084992 00000100:00100000:1.0:1783137433.749400:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990084992 00000100:00100000:1.0:1783137433.749441:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783137433.749449:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990084992:12345-0@lo:503: 00000100:00100000:1.0:1783137433.749606:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990084992:12345-0@lo:503: Request processed in 157us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.749614:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783137433.749661:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990084992:0@lo:503: 00000040:00080000:0.0:1783137433.751005:0:7517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783137433.751082:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990085120:0@lo:502: 00000100:00100000:0.0:1783137433.751153:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.751190:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137433.751839:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990085120 00000100:00100000:2.0:1783137433.751848:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990085120 00000100:00100000:2.0:1783137433.751902:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783137433.751911:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990085120:12345-0@lo:502: 00000100:00100000:2.0:1783137433.752292:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990085120:12345-0@lo:502: Request processed in 381us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137433.752300:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783137433.754061:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990085120:0@lo:502: 00000040:00080000:0.0:1783137433.754385:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783137433.754442:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783137433.754473:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783137433.754514:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783137433.754562:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783137433.754604:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783137433.754633:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783137433.754835:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783137433.754900:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783137433.754938:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783137433.754971:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783137433.755018:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783137433.755055:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783137433.755088:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783137433.755154:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783137433.755197:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783137433.755225:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783137433.755264:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783137433.755292:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783137433.755319:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783137433.755370:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783137433.755407:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783137433.755438:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783137433.755486:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783137433.756004:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783137433.756050:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783137433.756102:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783137433.756151:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1783137433.756185:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783137433.756235:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1783137433.756271:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1783137433.756323:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1783137433.756357:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1783137433.756417:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1783137433.756454:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1783137433.756496:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1783137433.758471:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1783137433.759784:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990085248:0@lo:502: 00000100:00100000:0.0:1783137433.759952:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.760006:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137433.760093:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990085248 00000100:00100000:2.0:1783137433.760101:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990085248 00000100:00100000:2.0:1783137433.760154:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783137433.760164:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990085248:12345-0@lo:502: 00000100:00100000:2.0:1783137433.760540:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990085248:12345-0@lo:502: Request processed in 376us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137433.760547:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783137433.760964:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990085248:0@lo:502: 00000040:00080000:0.0:1783137433.761075:0:7517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1783137433.761088:0:7517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783137433.766176:0:7531:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783137433.766195:0:7531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9709afe3cd40) 00000020:00000080:2.0:1783137433.766216:0:7531:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1783137433.766399:0:7531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9709b7c81800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783137433.766403:0:7531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9709b7c81800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783137433.766405:0:7531:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9709b7c81800 3 00010000:00080000:2.0:1783137433.766433:0:7531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9709b197b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.136@tcp at head 00010000:00010000:2.0:1783137433.771656:0:7531:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1783137433.776243:0:7531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783137433.776283:0:7531:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783137433.776295:0:7531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x88def104ac674878 00000100:00080000:2.0:1783137433.776304:0:7531:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783137433.776311:0:7531:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9709b197b800 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:2.0:1783137433.776344:0:7531:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bd018e00 x1869754990085376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783137433.776368:0:7531:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783137433.776555:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1869754990085376:0@lo:38: 00000100:00100000:3.0:1783137433.776631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137433.777164:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990085376 00000100:00100000:2.0:1783137433.777171:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990085376 00000100:00100000:2.0:1783137433.777211:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137433.777217:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1869754990085376:12345-0@lo:38: 00010000:00080000:2.0:1783137433.777241:0:5814:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1783137433.777286:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88def104ac67487f 00000004:00100000:2.0:1783137433.777299:0:5814:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783137433.777327:0:5814:0:(import.c:65:import_set_state_nolock()) ffff9709b197a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783137433.777393:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869754990085376:12345-0@lo:38: Request processed in 175us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137433.777401:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783137433.777457:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd018e00 x1869754990085376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783137443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137433.777468:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783137433.777474:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783137433.777481:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783137433.777485:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783137433.777487:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b197b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783137433.777492:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1869754990085376:0@lo:38: 00000100:00100000:1.0:1783137433.778247:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990085760:0@lo:400: 00000100:00100000:1.0:1783137433.778290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137433.778333:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990085760 00000100:00100000:1.0:1783137433.778348:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990085760 00000100:00100000:1.0:1783137433.778391:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137433.778398:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990085760:12345-0@lo:400: 00000100:00100000:1.0:1783137433.778442:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990085760:12345-0@lo:400: Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.778449:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783137433.778464:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137433.778487:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd922d80 x1869754990085760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137433.778498:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990085760:0@lo:400: 00000100:00100000:3.0:1783137433.778566:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990085632:0@lo:400: 00000100:00100000:3.0:1783137433.778597:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137433.778626:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137433.778631:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990085504:0@lo:400: 00000100:00100000:3.0:1783137433.778650:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137433.779764:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990085632 00000100:00100000:1.0:1783137433.779773:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990085632 00000100:00100000:1.0:1783137433.779869:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990085504 00000100:00100000:1.0:1783137433.779874:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990085504 00000100:00100000:1.0:1783137433.779896:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783137433.779905:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990085632:12345-0@lo:400: 00000100:00100000:1.0:1783137433.779971:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990085632:12345-0@lo:400: Request processed in 68us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.779979:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783137433.780004:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783137433.780011:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990085504:12345-0@lo:400: 00000100:00100000:1.0:1783137433.780038:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990085504:12345-0@lo:400: Request processed in 29us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137433.780044:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1783137433.780088:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd922300 x1869754990085504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137433.780100:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990085504:0@lo:400: 00010000:00080000:1.0:1783137433.780138:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd921180 x1869754990085632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137433.780146:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990085632:0@lo:400: 00000100:00080000:3.0:1783137433.780336:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1783137433.780517:0:7531:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1783137433.780669:0:7517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1783137433.780695:0:7517:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783137433.780717:0:7517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137433.780727:0:7517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783137433.780773:0:7517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783137433.780776:0:7517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783137433.780777:0:7517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783137433.780779:0:7517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783137433.780780:0:7517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783137433.780781:0:7517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783137433.780783:0:7517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783137433.780785:0:7517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783137433.780786:0:7517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783137433.780788:0:7517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783137433.780821:0:7517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783137433.780824:0:7517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1783137433.780827:0:7517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783137433.780828:0:7517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783137433.780829:0:7517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783137433.780830:0:7517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783137433.780832:0:7517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783137433.780833:0:7517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783137433.780834:0:7517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783137433.780835:0:7517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783137433.780836:0:7517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783137433.780837:0:7517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783137433.780838:0:7517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783137433.780868:0:7517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783137433.780884:0:7517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986663100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990085888:0@lo:253: 00000100:00100000:3.0:1783137433.780931:0:7517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137433.780956:0:7517:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709885ad0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137433.781234:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990085888 00000100:00100000:1.0:1783137433.781240:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990085888 00000100:00100000:1.0:1783137433.781278:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783137433.781286:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:7517:x1869754990085888:12345-0@lo:253: 20000000:01000000:1.0:1783137433.781306:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783137433.781317:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783137433.781894:0:7533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd018e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7533:1869754990086016:0@lo:901: 00000100:00100000:2.0:1783137433.781933:0:7533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137433.781958:0:7533:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a092f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137433.785381:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990086016 00000100:00100000:3.0:1783137433.785394:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990086016 00000100:00100000:3.0:1783137433.785446:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137433.785453:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7533:x1869754990086016:12345-0@lo:901: 00010000:00080000:2.0:1783137433.786037:0:7533:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd018e00 x1869754990086016/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783137449 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137433.786051:0:7533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd018e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7533:1869754990086016:0@lo:901: 00000100:00100000:3.0:1783137433.786221:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7533:x1869754990086016:12345-0@lo:901: Request processed in 398us (3917us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137433.786231:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783137433.786254:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1783137433.854922:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783137433.854941:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783137433.855686:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783137433.855692:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783137433.855713:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137433.855730:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6747c2 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137433.855740:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137433.855778:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6747c2 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137433.855821:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6747c2 expref: 14 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137433.855835:0:5830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1869754990086144:0@lo:104: 00000100:00100000:3.0:1783137433.855903:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137433.855945:0:5830:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bc952240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137433.856004:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990086144 00000100:00100000:0.0:1783137433.856011:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990086144 00000100:00100000:0.0:1783137433.856072:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137433.856082:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e4795b-54a4-4490-bb2a-864b21234c99+3:5830:x1869754990086144:12345-0@lo:104: 00010000:00010000:0.0:1783137433.856094:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.856160:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783137433.856166:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73e4795b-54a4-4490-bb2a-864b21234c99+3:5830:x1869754990086144:12345-0@lo:104: Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.856173:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1783137433.856193:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137433.856199:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.856206:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2173c00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137433.856209:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.856217:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137433.856224:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137433.856230:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783137433.856266:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.856273:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137433.856292:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.856299:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2173c00/0x88def104ac6747c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6747c9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.856321:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137433.856323:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137433.856324:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137433.856575:0:5830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1869754990086144:0@lo:104: 00010000:00010000:3.0:1783137433.856593:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.857211:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990086272:0@lo:103: 00000100:00100000:2.0:1783137433.857259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137433.857375:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990086272 00000100:00100000:0.0:1783137433.857381:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990086272 00010000:00010000:0.0:1783137433.857402:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6747c2 expref: 15 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137433.857433:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137433.857440:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+15:3307:x1869754990086272:12345-0@lo:103: 00010000:00010000:0.0:1783137433.857453:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137433.857457:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6747c2 expref: 15 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857466:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6747c2 expref: 15 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857479:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2044600/0x88def104ac6747c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6747c2 expref: 15 pid: 5807 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857491:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857507:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783137433.857519:0:5801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001827487s 00010000:00010000:0.0:1783137433.857523:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857529:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857535:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857541:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857547:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970981489600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137433.857550:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857557:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857570:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137433.857578:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137433.857610:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+14:3307:x1869754990086272:12345-0@lo:103: Request processed in 170us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137433.857617:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1783137433.857705:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137433.857715:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137433.857720:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981489600/0x88def104ac674886 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137433.857870:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990086272:0@lo:103: 00000100:00100000:3.0:1783137433.861219:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+13:7517:x1869754990085888:12345-0@lo:253: Request processed in 79925us (80279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137433.861232:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783137433.861304:0:7517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986663100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73e4795b-54a4-4490-bb2a-864b21234c99:7517:1869754990085888:0@lo:253: 10000000:01000000:0.0:1783137433.861319:0:7517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783137433.861322:0:7517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783137433.861324:0:7517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783137433.861325:0:7517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137433.861326:0:7517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137433.861327:0:7517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137433.861328:0:7517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137433.861330:0:7517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137433.861331:0:7517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783137433.861333:0:7517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783137433.861334:0:7517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137433.861336:0:7517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783137433.861355:0:7517:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783137433.868055:0:7517:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137433.868347:0:7517:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137433.868571:0:7517:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137433.868767:0:7517:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137433.870184:0:7517:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137433.870425:0:7517:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783137433.871400:0:7517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1783137434.088207:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783137434.131190:0:7517:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783137434.131197:0:7517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783137434.131228:0:7517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783137434.131285:0:7517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.136@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783137434.131302:0:7517:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783137434.131328:0:7517:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783137435.116093:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137436.135221:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137436.583194:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990086400:0@lo:13: 00000100:00100000:2.0:1783137436.583261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137436.584424:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990086400 00000100:00100000:3.0:1783137436.584433:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990086400 00000100:00100000:2.0:1783137436.585043:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137436.585054:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990086400:12345-0@lo:13: 00002000:00000024:2.0:1783137436.585097:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137436.585179:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990086400:12345-0@lo:13: Request processed in 126us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137436.585187:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783137436.585329:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc35dc00 x1869754990086400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137436.585424:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990086400:0@lo:13: 00000100:00080000:3.0:1783137436.585556:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783137437.158989:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137438.183544:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137439.143117:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990086912:0@lo:400: 00000100:00100000:0.0:1783137439.143271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137439.143334:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783137439.143341:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990086528:0@lo:400: 00000100:00100000:0.0:1783137439.143370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137439.143391:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990087040:0@lo:400: 00000100:00100000:0.0:1783137439.143419:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137439.143445:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990086656:0@lo:400: 00000100:00100000:0.0:1783137439.143465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137439.143483:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137439.143488:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990086784:0@lo:400: 00000100:00100000:0.0:1783137439.143508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137439.143535:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990086912 00000100:00100000:0.0:1783137439.143543:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990086912 00000100:00100000:0.0:1783137439.143591:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137439.143600:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990086912:12345-0@lo:400: 00000100:00100000:0.0:1783137439.143649:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990086912:12345-0@lo:400: Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137439.143657:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137439.143678:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990087040 00000100:00100000:0.0:1783137439.143681:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990087040 00000100:00100000:0.0:1783137439.143704:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990086656 00000100:00100000:0.0:1783137439.143707:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990086656 00000100:00100000:0.0:1783137439.143718:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990086784 00000100:00100000:0.0:1783137439.143720:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990086784 00000100:00100000:0.0:1783137439.143734:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137439.143740:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990087040:12345-0@lo:400: 00000100:00100000:0.0:1783137439.143769:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990087040:12345-0@lo:400: Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137439.143782:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137439.143813:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137439.143820:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990086656:12345-0@lo:400: 00000100:00100000:0.0:1783137439.143853:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990086656:12345-0@lo:400: Request processed in 34us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137439.143859:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137439.143870:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783137439.143876:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990086784:12345-0@lo:400: 00000100:00100000:0.0:1783137439.143901:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990086784:12345-0@lo:400: Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137439.143906:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1783137439.143928:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137439.143932:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783137439.143963:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc35d880 x1869754990086784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137439.143978:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990086784:0@lo:400: 00010000:00080000:0.0:1783137439.143989:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc35d500 x1869754990086656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137439.143997:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990086656:0@lo:400: 00010000:00080000:0.0:1783137439.144026:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc35e300 x1869754990087040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137439.144036:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990087040:0@lo:400: 00010000:00080000:0.0:1783137439.144046:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc35ce00 x1869754990086912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137439.144081:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990086912:0@lo:400: 00000100:00100000:2.0:1783137439.144326:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990086528 00000100:00100000:2.0:1783137439.144331:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990086528 00000100:00100000:2.0:1783137439.144360:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783137439.144366:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:3308:x1869754990086528:12345-0@lo:400: 00000100:00100000:2.0:1783137439.144406:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:3308:x1869754990086528:12345-0@lo:400: Request processed in 41us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137439.144425:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783137439.144463:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990086528:0@lo:400: 00010000:00010000:0.0:1783137439.206976:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137440.231613:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137440.553228:0:7874:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1783137440.680813:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783137440.680821:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9709886eb800 from 30 10000000:01000000:3.0:1783137440.680825:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783137440.680867:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.680879:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.680890:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137440.680915:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087168:0@lo:101: 00000100:00100000:3.0:1783137440.680979:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137440.681045:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709861d8540 going to sleep for 11 seconds 00000100:00100000:2.0:1783137440.682862:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990087168 00000100:00100000:2.0:1783137440.682874:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990087168 00000100:00100000:2.0:1783137440.682949:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783137440.682960:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990087168:12345-0@lo:101: 00010000:00010000:2.0:1783137440.682976:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137440.682991:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67488d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.683018:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67488d expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.683028:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67488d expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.683048:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2045000, rc 0) 00000100:00100000:2.0:1783137440.683142:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990087168:12345-0@lo:101: Request processed in 183us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137440.683149:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783137440.685602:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087168:0@lo:101: 00010000:00010000:0.0:1783137440.685630:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137440.685643:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137440.685715:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087296:0@lo:501: 00000100:00100000:0.0:1783137440.685771:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137440.686026:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990087296 00000100:00100000:2.0:1783137440.686033:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990087296 00000100:00100000:0.0:1783137440.686088:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098c06ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137440.686089:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783137440.686114:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990087296:12345-0@lo:501: 00000100:00100000:2.0:1783137440.686497:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990087296:12345-0@lo:501: Request processed in 394us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137440.686506:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783137440.687261:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087296:0@lo:501: 00000100:00100000:0.0:1783137440.687301:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087424:0@lo:503: 00000100:00100000:0.0:1783137440.687353:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.687379:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098c06ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137440.687430:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990087424 00000100:00100000:3.0:1783137440.687435:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990087424 00000100:00100000:3.0:1783137440.687468:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783137440.687476:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990087424:12345-0@lo:503: 00000100:00100000:3.0:1783137440.687777:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990087424:12345-0@lo:503: Request processed in 301us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137440.687784:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783137440.688207:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087424:0@lo:503: 00000100:00100000:2.0:1783137440.698103:0:7880:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd019880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7880:1869754990087552:0@lo:502: 00000100:00100000:2.0:1783137440.698181:0:7880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137440.698217:0:7880:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709887b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1783137440.698690:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990087552 00000100:00100000:0.0:1783137440.698698:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990087552 00000100:00100000:0.0:1783137440.698748:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783137440.698757:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:7880:x1869754990087552:12345-0@lo:502: 00000100:00100000:0.0:1783137440.699134:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:7880:x1869754990087552:12345-0@lo:502: Request processed in 377us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.699143:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783137440.700034:0:7880:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd019880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7880:1869754990087552:0@lo:502: 00000100:00100000:2.0:1783137440.700116:0:7880:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd019880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7880:1869754990087680:0@lo:502: 00000100:00100000:2.0:1783137440.700170:0:7880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137440.700209:0:7880:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709887b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1783137440.705084:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990087680 00000100:00100000:0.0:1783137440.705100:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990087680 00000100:00100000:0.0:1783137440.705163:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783137440.705172:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:7880:x1869754990087680:12345-0@lo:502: 00000100:00100000:0.0:1783137440.705464:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:7880:x1869754990087680:12345-0@lo:502: Request processed in 292us (5292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.705473:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783137440.705850:0:7880:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd019880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7880:1869754990087680:0@lo:502: 00000040:00080000:2.0:1783137440.705885:0:7880:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783137440.706309:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783137440.706331:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137440.706342:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137440.706354:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137440.706365:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783137440.706368:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1783137440.706370:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783137440.706401:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137440.706409:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137440.706429:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137440.706451:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087808:0@lo:101: 00000100:00100000:0.0:1783137440.706497:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.706540:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a21f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137440.706994:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990087808 00000100:00100000:2.0:1783137440.707000:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990087808 00000100:00100000:2.0:1783137440.707065:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783137440.707074:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990087808:12345-0@lo:101: 00010000:00010000:2.0:1783137440.707095:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137440.707108:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67489b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.707131:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67489b expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.707141:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67489b expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.707150:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2044600, rc 0) 00000100:00100000:2.0:1783137440.707195:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990087808:12345-0@lo:101: Request processed in 122us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137440.707202:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783137440.707242:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087808:0@lo:101: 00010000:00010000:2.0:1783137440.707257:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.707266:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137440.707329:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd019880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087936:0@lo:501: 00000100:00100000:2.0:1783137440.707357:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137440.707371:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709887b8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137440.707382:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990087936 00000100:00100000:2.0:1783137440.707385:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990087936 00000100:00100000:2.0:1783137440.707403:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783137440.707408:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990087936:12345-0@lo:501: 00000100:00100000:2.0:1783137440.708184:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990087936:12345-0@lo:501: Request processed in 773us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137440.708192:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783137440.708262:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd019880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990087936:0@lo:501: 00000100:00100000:0.0:1783137440.708296:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990088064:0@lo:503: 00000100:00100000:0.0:1783137440.708350:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.708373:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a21f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137440.708650:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990088064 00000100:00100000:2.0:1783137440.708655:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990088064 00000100:00100000:2.0:1783137440.708718:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783137440.708726:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990088064:12345-0@lo:503: 00000100:00100000:2.0:1783137440.709233:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990088064:12345-0@lo:503: Request processed in 505us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137440.709242:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783137440.717071:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990088064:0@lo:503: 00000100:00100000:1.0:1783137440.718241:0:7882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7882:1869754990088192:0@lo:502: 00000100:00100000:1.0:1783137440.718317:0:7882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137440.718361:0:7882:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137440.718403:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990088192 00000100:00100000:2.0:1783137440.718408:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990088192 00000100:00100000:2.0:1783137440.718461:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783137440.718470:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:7882:x1869754990088192:12345-0@lo:502: 00000100:00100000:2.0:1783137440.718719:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:7882:x1869754990088192:12345-0@lo:502: Request processed in 249us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137440.718727:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783137440.719042:0:7882:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7882:1869754990088192:0@lo:502: 00000020:01000000:1.0:1783137440.719079:0:7882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137440.719088:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137440.719090:0:7882:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783137440.719095:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783137440.719098:0:7882:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783137440.719118:0:7882:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7882:1869754990088320:0@lo:502: 00000100:00100000:1.0:1783137440.719154:0:7882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137440.719186:0:7882:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137440.719233:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990088320 00000100:00100000:2.0:1783137440.719238:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990088320 00000100:00100000:2.0:1783137440.719269:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783137440.719276:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:7882:x1869754990088320:12345-0@lo:502: 00000100:00100000:2.0:1783137440.719398:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:7882:x1869754990088320:12345-0@lo:502: Request processed in 121us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137440.719404:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783137440.719570:0:7882:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7882:1869754990088320:0@lo:502: 00000020:01000000:1.0:1783137440.719586:0:7882:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137440.719590:0:7882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137440.719592:0:7882:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783137440.719595:0:7882:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1783137440.719729:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1783137440.719769:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783137440.719780:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.719971:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137440.719983:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783137440.719985:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97099cc6e000 from 30 10000000:01000000:2.0:1783137440.719988:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783137440.720021:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.720030:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.720038:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137440.720051:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990088448:0@lo:101: 00000100:00100000:2.0:1783137440.720089:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137440.720117:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098c133540 going to sleep for 11 seconds 00000100:00100000:1.0:1783137440.720152:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990088448 00000100:00100000:1.0:1783137440.720157:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990088448 00000100:00100000:1.0:1783137440.720190:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783137440.720198:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990088448:12345-0@lo:101: 00010000:00010000:1.0:1783137440.720207:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137440.720219:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6748a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.720238:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6748a9 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.720248:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6748a9 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.720257:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2172400, rc 0) 00000100:00100000:1.0:1783137440.720286:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990088448:12345-0@lo:101: Request processed in 89us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137440.720292:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783137440.720418:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990088448:0@lo:101: 00010000:00010000:2.0:1783137440.720503:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137440.720513:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137440.720565:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990088576:0@lo:501: 00000100:00100000:2.0:1783137440.720609:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137440.720663:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098c133540 going to sleep for 11 seconds 00000100:00100000:3.0:1783137440.722259:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990088576 00000100:00100000:3.0:1783137440.722273:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990088576 00000100:00100000:3.0:1783137440.722325:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783137440.722335:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990088576:12345-0@lo:501: 00000100:00100000:3.0:1783137440.722632:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990088576:12345-0@lo:501: Request processed in 298us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137440.722640:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783137440.722693:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990088576:0@lo:501: 00000100:00100000:3.0:1783137440.722739:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990088704:0@lo:503: 00000100:00100000:3.0:1783137440.722781:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137440.722817:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709861d8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137440.722829:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990088704 00000100:00100000:3.0:1783137440.722833:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990088704 00000100:00100000:3.0:1783137440.722854:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783137440.722860:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990088704:12345-0@lo:503: 00000100:00100000:3.0:1783137440.724504:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990088704:12345-0@lo:503: Request processed in 1637us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137440.724517:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783137440.724588:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990088704:0@lo:503: 00000100:00100000:1.0:1783137440.728643:0:7883:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7883:1869754990088832:0@lo:502: 00000100:00100000:1.0:1783137440.728721:0:7883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137440.728776:0:7883:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137440.729119:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990088832 00000100:00100000:3.0:1783137440.729127:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990088832 00000100:00100000:3.0:1783137440.729179:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783137440.729188:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+16:7883:x1869754990088832:12345-0@lo:502: 00000100:00100000:3.0:1783137440.729447:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+16:7883:x1869754990088832:12345-0@lo:502: Request processed in 259us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137440.729455:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783137440.729530:0:7883:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7883:1869754990088832:0@lo:502: 00000100:00100000:1.0:1783137440.729580:0:7883:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7883:1869754990088960:0@lo:502: 00000100:00100000:1.0:1783137440.729625:0:7883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137440.729658:0:7883:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137440.729703:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990088960 00000100:00100000:0.0:1783137440.729708:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990088960 00000100:00100000:0.0:1783137440.729745:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783137440.729752:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:7883:x1869754990088960:12345-0@lo:502: 00000100:00100000:0.0:1783137440.729949:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:7883:x1869754990088960:12345-0@lo:502: Request processed in 196us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.729956:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783137440.730163:0:7883:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7883:1869754990088960:0@lo:502: 00000040:00080000:1.0:1783137440.730185:0:7883:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783137440.730391:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783137440.730414:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137440.730434:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137440.730445:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137440.730455:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783137440.730458:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff97099cc6e000 from 5 10000000:01000000:0.0:1783137440.730461:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783137440.730489:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137440.730498:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137440.730507:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137440.730529:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089088:0@lo:101: 00000100:00100000:0.0:1783137440.730563:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.730597:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab2900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137440.730700:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990089088 00000100:00100000:1.0:1783137440.730705:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990089088 00000100:00100000:1.0:1783137440.730743:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783137440.730762:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990089088:12345-0@lo:101: 00010000:00010000:1.0:1783137440.730772:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137440.730813:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2173c00/0x88def104ac6748be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6748b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.730835:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2173c00/0x88def104ac6748be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6748b7 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.730847:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2173c00/0x88def104ac6748be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6748b7 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.730855:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2173c00, rc 0) 00000100:00100000:1.0:1783137440.730895:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990089088:12345-0@lo:101: Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137440.730901:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783137440.730933:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089088:0@lo:101: 00010000:00010000:1.0:1783137440.730946:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.730954:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137440.731004:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089216:0@lo:256: 00000100:00100000:1.0:1783137440.731046:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137440.731075:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137440.731086:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990089216 00000100:00100000:1.0:1783137440.731089:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990089216 00000100:00100000:1.0:1783137440.731105:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783137440.731110:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990089216:12345-0@lo:256: 20000000:01000000:1.0:1783137440.731123:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783137440.731137:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783137440.731140:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1783137440.731207:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990089216:12345-0@lo:256: Request processed in 95us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137440.731213:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783137440.731242:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089216:0@lo:256: 10000000:01000000:1.0:1783137440.731283:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783137440.731290:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.731297:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137440.731305:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783137440.731307:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1783137440.731309:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783137440.731322:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.731338:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.731344:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137440.731355:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089344:0@lo:101: 00000100:00100000:1.0:1783137440.731378:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137440.731392:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137440.731403:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990089344 00000100:00100000:1.0:1783137440.731407:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990089344 00000100:00100000:1.0:1783137440.731623:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783137440.731633:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990089344:12345-0@lo:101: 00010000:00010000:1.0:1783137440.731642:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137440.731652:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6748c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.731668:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6748c5 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.731677:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6748c5 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.731685:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2173a00, rc 0) 00000100:00100000:1.0:1783137440.731720:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990089344:12345-0@lo:101: Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137440.731725:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783137440.731757:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089344:0@lo:101: 00010000:00010000:1.0:1783137440.731777:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137440.731877:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137440.731929:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089472:0@lo:501: 00000100:00100000:1.0:1783137440.731957:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137440.731980:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137440.731992:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990089472 00000100:00100000:1.0:1783137440.731996:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990089472 00000100:00100000:1.0:1783137440.732172:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783137440.732180:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990089472:12345-0@lo:501: 00000100:00100000:1.0:1783137440.732416:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990089472:12345-0@lo:501: Request processed in 237us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137440.732452:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089472:0@lo:501: 00000100:00100000:3.0:1783137440.732483:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089600:0@lo:503: 00000100:00100000:3.0:1783137440.732521:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137440.732536:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709861d83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137440.732548:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990089600 00000100:00100000:3.0:1783137440.732552:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990089600 00000100:00100000:3.0:1783137440.732570:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783137440.732576:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990089600:12345-0@lo:503: 00000100:00100000:1.0:1783137440.732662:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783137440.733176:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990089600:12345-0@lo:503: Request processed in 598us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137440.733184:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783137440.734006:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990089600:0@lo:503: 00000100:00100000:3.0:1783137440.735901:0:7885:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7885:1869754990089728:0@lo:502: 00000100:00100000:3.0:1783137440.736041:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137440.736093:0:7885:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709861d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137440.736098:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990089728 00000100:00100000:0.0:1783137440.736107:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990089728 00000100:00100000:0.0:1783137440.736154:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783137440.736164:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:7885:x1869754990089728:12345-0@lo:502: 00000100:00100000:0.0:1783137440.736473:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:7885:x1869754990089728:12345-0@lo:502: Request processed in 310us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.736481:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783137440.740113:0:7885:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7885:1869754990089728:0@lo:502: 00000020:01000000:3.0:1783137440.740168:0:7885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783137440.740178:0:7885:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783137440.740187:0:7885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137440.740197:0:7885:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783137440.740205:0:7885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783137440.740210:0:7885:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.136@tcp to nid 0x20000c0a8cb88 (192.168.203.136@tcp) 00000020:01000000:3.0:1783137440.740238:0:7885:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783137440.740242:0:7885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783137440.740261:0:7885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9709bd93b380) 00000020:00000080:3.0:1783137440.740288:0:7885:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1783137440.740295:0:7885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783137440.740394:0:7885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783137440.740401:0:7885:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783137440.740408:0:7885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac6748da 00010000:00080000:3.0:1783137440.740440:0:7885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9709b7994800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.136@tcp at head 00010000:00010000:3.0:1783137440.740674:0:7885:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1783137440.742362:0:7885:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783137440.742382:0:7885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783137440.746650:0:7885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783137440.746916:0:7885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783137440.746966:0:7885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783137440.747021:0:7885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1783137440.754610:0:7886:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783137440.754618:0:7886:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783137440.756329:0:7885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783137440.756342:0:7885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783137440.756376:0:7885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783137440.756397:0:7885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac6748e1 00000100:00080000:3.0:1783137440.756409:0:7885:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783137440.756414:0:7885:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9709b7994800 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137440.756447:0:7885:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff970986661500 x1869754990089856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783137440.756475:0:7885:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783137440.756524:0:7885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137440.756528:0:7885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137440.756536:0:7885:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783137440.756541:0:7885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137440.756544:0:7885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137440.756546:0:7885:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783137440.756548:0:7885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783137440.756550:0:7885:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783137440.756577:0:7885:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986662a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7885:1869754990089984:0@lo:502: 00000100:00100000:3.0:1783137440.756648:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137440.756681:0:7885:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709861d8000 going to sleep for 11 seconds 00000100:00100000:0.0:1783137440.756739:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990089856:0@lo:8: 00000100:00100000:0.0:1783137440.756778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.756935:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990089984 00000100:00100000:0.0:1783137440.756942:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990089984 00000100:00100000:0.0:1783137440.756986:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783137440.756997:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+18:7885:x1869754990089984:12345-0@lo:502: 00000100:00100000:1.0:1783137440.757034:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990090368:0@lo:400: 00000100:00100000:1.0:1783137440.757083:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137440.757115:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137440.757123:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990090496:0@lo:400: 00000100:00100000:1.0:1783137440.757155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.757255:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+18:7885:x1869754990089984:12345-0@lo:502: Request processed in 260us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.757262:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783137440.757299:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990089856 00000100:00100000:0.0:1783137440.757303:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990089856 00000100:00100000:0.0:1783137440.757326:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990090368 00000100:00100000:0.0:1783137440.757329:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990090368 00000100:00100000:0.0:1783137440.757347:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137440.757353:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990090368:12345-0@lo:400: 00000100:00100000:0.0:1783137440.757391:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990090368:12345-0@lo:400: Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.757404:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137440.757415:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783137440.757419:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1869754990089856:12345-0@lo:8: 00010000:00080000:0.0:1783137440.757439:0:6618:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1783137440.757465:0:6618:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac6748e8 00002000:00100000:0.0:1783137440.757478:0:6618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9709b78ef000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113655 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783137440.757482:0:6618:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1783137440.757486:0:6618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1783137440.757590:0:6618:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783137440.757728:0:6618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783137440.757751:0:6618:0:(import.c:65:import_set_state_nolock()) ffff9709b78ee800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783137440.757830:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869754990089856:12345-0@lo:8: Request processed in 408us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.757836:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783137440.757856:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990090112:0@lo:400: 00000100:00100000:0.0:1783137440.757881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.757901:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137440.757907:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990090240:0@lo:400: 00000100:00100000:0.0:1783137440.757926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.757952:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990090496 00000100:00100000:0.0:1783137440.757956:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990090496 00000100:00100000:0.0:1783137440.757979:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990090112 00000100:00100000:0.0:1783137440.757982:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990090112 00000100:00100000:0.0:1783137440.757993:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990090240 00000100:00100000:0.0:1783137440.757995:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990090240 00000100:00100000:0.0:1783137440.758008:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783137440.758014:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990090496:12345-0@lo:400: 00000100:00100000:0.0:1783137440.758066:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990090496:12345-0@lo:400: Request processed in 40us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.758073:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783137440.758088:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137440.758094:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990090112:12345-0@lo:400: 00000100:00100000:0.0:1783137440.758126:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990090112:12345-0@lo:400: Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.758132:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137440.758143:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783137440.758149:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990090240:12345-0@lo:400: 00000100:00100000:0.0:1783137440.758174:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990090240:12345-0@lo:400: Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.758179:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1783137440.758213:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd921500 x1869754990090496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137440.758227:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990090496:0@lo:400: 00010000:00080000:0.0:1783137440.758240:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd921880 x1869754990090368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137440.758249:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990090368:0@lo:400: 00010000:00080000:0.0:1783137440.758279:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970986661500 x1869754990089856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783137450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137440.758288:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783137440.758295:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783137440.758303:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783137440.758313:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783137440.758316:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b7994800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783137440.758324:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783137440.758329:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990089856:0@lo:8: 00010000:00080000:0.0:1783137440.758362:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd922d80 x1869754990090240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137440.758372:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990090240:0@lo:400: 00010000:00080000:0.0:1783137440.758381:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd922300 x1869754990090112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137440.758388:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990090112:0@lo:400: 00000004:00080000:1.0:1783137440.763469:0:7886:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783137440.763753:0:7886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 196660960219ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783137440.764198:0:7885:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986662a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:7885:1869754990089984:0@lo:502: 00000020:01000000:1.0:1783137440.764246:0:7885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137440.764254:0:7885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137440.764256:0:7885:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783137440.764261:0:7885:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1783137440.765171:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1783137440.765197:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783137440.765208:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.765220:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137440.765230:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783137440.765232:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9709873db380 from 1 10000000:01000000:3.0:1783137440.765235:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783137440.765268:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.765276:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.765286:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137440.765306:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990090624:0@lo:101: 00000100:00100000:3.0:1783137440.765368:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137440.765416:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709861d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783137440.765434:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990090624 00000100:00100000:3.0:1783137440.765441:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990090624 00000100:00100000:3.0:1783137440.765485:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783137440.765494:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990090624:12345-0@lo:101: 00010000:00010000:3.0:1783137440.765507:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137440.765520:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6748ef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.765542:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6748ef expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.765553:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6748ef expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.765561:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981488c00, rc 0) 00000100:00100000:3.0:1783137440.765596:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990090624:12345-0@lo:101: Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137440.765602:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783137440.765633:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990090624:0@lo:101: 00010000:00010000:3.0:1783137440.765646:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.765655:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137440.765699:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990090752:0@lo:501: 00000100:00100000:3.0:1783137440.765721:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137440.765735:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709861d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783137440.765752:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990090752 00000100:00100000:3.0:1783137440.765755:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990090752 00000100:00100000:3.0:1783137440.765771:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783137440.765777:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990090752:12345-0@lo:501: 00000100:00100000:3.0:1783137440.766415:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990090752:12345-0@lo:501: Request processed in 634us (689us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783137440.766423:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783137440.766477:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990090752:0@lo:501: 10000000:01000000:3.0:1783137440.766499:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783137440.766506:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137440.766515:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137440.844553:0:7888:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783137440.844582:0:7888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7888:1869754990091008:0@lo:7: 00000100:00100000:0.0:1783137440.844645:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.844689:0:7888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137440.844703:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990090880:0@lo:13: 00000100:00100000:0.0:1783137440.844741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.844787:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990091008 00000100:00100000:0.0:1783137440.844826:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990091008 00000100:00100000:0.0:1783137440.844875:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783137440.844882:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7888:x1869754990091008:12345-0@lo:7: 00000100:00100000:0.0:1783137440.868344:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990090880 00000100:00100000:0.0:1783137440.868356:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990090880 00000100:00100000:0.0:1783137440.868413:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783137440.868486:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1869754990090880:12345-0@lo:13: 00002000:00000024:0.0:1783137440.868524:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1783137440.868655:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1869754990090880:12345-0@lo:13: Request processed in 234us (23912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.868662:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783137440.868701:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783137440.878207:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc35e300 x1869754990090880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137440.878235:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990090880:0@lo:13: 00002000:00080000:0.0:1783137440.902513:0:6618:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1783137440.902521:0:6618:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783137440.902611:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7888:x1869754990091008:12345-0@lo:7: Request processed in 57725us (57962us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137440.902620:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783137440.903265:0:7888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc35ce00 x1869754990091008/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783137456 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137440.903280:0:7888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7888:1869754990091008:0@lo:7: 00000004:00080000:0.0:1783137440.903293:0:7888:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783137440.903329:0:7888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985321c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7888:1869754990091136:0@lo:5: 00000100:00100000:0.0:1783137440.903825:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.903865:0:7888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137440.903885:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990091136 00000100:00100000:0.0:1783137440.903890:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990091136 00000100:00100000:0.0:1783137440.903923:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137440.903930:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7888:x1869754990091136:12345-0@lo:5: 00002000:00080000:0.0:1783137440.903953:0:6619:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783137440.903957:0:6619:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783137440.904962:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985323b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7888:x1869754990091136:12345-0@lo:5: Request processed in 1027us (1132us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783137440.904972:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783137440.905023:0:7888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970985321c00 x1869754990091136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137456 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137440.905118:0:7888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985321c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7888:1869754990091136:0@lo:5: 00000004:00080000:0.0:1783137440.905136:0:7888:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783137440.905168:0:7888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985323800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7888:1869754990091264:0@lo:700: 00000100:00100000:0.0:1783137440.905199:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137440.905219:0:7888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137440.909319:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990091264 00000100:00100000:2.0:1783137440.909334:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990091264 00000100:00100000:2.0:1783137440.909382:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137440.909392:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7888:x1869754990091264:12345-0@lo:700: 00000100:00100000:2.0:1783137440.909448:0:6627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd019180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6627:1869754990091392:0@lo:700: 00000100:00100000:2.0:1783137440.909506:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137440.909534:0:6627:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099cf6ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137440.910007:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990091392 00000100:00100000:2.0:1783137440.910013:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990091392 00000100:00100000:2.0:1783137440.910045:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137440.910051:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6627:x1869754990091392:12345-0@lo:700: 00000004:00080000:2.0:1783137440.967189:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1783137441.038321:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1783137441.043527:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6627:x1869754990091392:12345-0@lo:700: Request processed in 133468us (134013us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137441.043541:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783137441.043630:0:6627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd019180 x1869754990091392/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783137456 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137441.043645:0:6627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd019180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6627:1869754990091392:0@lo:700: 40000000:02000000:3.0:1783137441.043658:0:6627:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1783137441.123673:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7888:x1869754990091264:12345-0@lo:700: Request processed in 214275us (218466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137441.123690:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1783137441.123723:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1783137441.123736:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1783137441.123779:0:7888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970985323800 x1869754990091264/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783137456 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137441.123825:0:7888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985323800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7888:1869754990091264:0@lo:700: 00000004:02000040:3.0:1783137441.150885:0:7888:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1783137441.161691:0:7888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7888:1869754990091520:0@lo:5: 00000100:00100000:3.0:1783137441.161757:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137441.161815:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990091520 00000100:00100000:3.0:1783137441.161821:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990091520 00000100:00100000:3.0:1783137441.161869:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783137441.161877:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7888:x1869754990091520:12345-0@lo:5: 00000100:00100000:1.0:1783137441.172885:0:7888:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea780 going to sleep for 11 seconds 00002000:00080000:3.0:1783137441.176482:0:6619:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1783137441.176501:0:6619:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1783137441.179855:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7888:x1869754990091520:12345-0@lo:5: Request processed in 17972us (18092us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783137441.179867:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783137441.180097:0:7888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970986660380 x1869754990091520/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137457 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137441.180111:0:7888:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783137441.180126:0:7888:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff970986660380 x1869754990091520/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783137457 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137441.180137:0:7888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7888:1869754990091520:0@lo:5: 00000004:00080000:1.0:1783137441.180149:0:7888:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1783137441.269741:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137441.713181:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137441.713212:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990091648:0@lo:13: 00000100:00100000:2.0:1783137441.713282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137441.713351:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990091648 00000100:00100000:0.0:1783137441.713360:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990091648 00000100:00100000:0.0:1783137441.713421:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137441.713432:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990091648:12345-0@lo:13: 00002000:00000024:0.0:1783137441.713468:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137441.713532:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990091648:12345-0@lo:13: Request processed in 102us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137441.713540:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1783137441.713560:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783137441.713817:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970985322680 x1869754990091648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137441.713839:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990091648:0@lo:13: 00010000:00010000:1.0:1783137442.290127:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137443.303854:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137444.332521:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783137445.145774:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1783137445.353338:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137445.580556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137445.580899:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974339200 00000100:00100000:0.0:1783137445.580909:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974339200 00000100:00100000:0.0:1783137445.580945:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:0.0:1783137445.580953:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1869754974339200:12345-192.168.203.36@tcp:250: 00010000:00080000:0.0:1783137445.580979:0:5809:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from ab947cb7-67e1-4bdb-9ed6-c2a2167bac32@192.168.203.36@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1783137445.581007:0:5809:0:(genops.c:1406:class_connect()) connect: client ab947cb7-67e1-4bdb-9ed6-c2a2167bac32, cookie 0x88def104ac6748fd 00000100:00080000:0.0:1783137445.581144:0:5809:0:(import.c:65:import_set_state_nolock()) ffff9709b78eb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783137445.581205:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+5:2350:x1869754974339200:12345-192.168.203.36@tcp:250: Request processed in 252us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137445.581213:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:1.0:1783137445.589157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137445.589247:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974339328 00000100:00100000:2.0:1783137445.589256:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974339328 00000100:00100000:2.0:1783137445.589318:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:2.0:1783137445.589328:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+5:5557:x1869754974339328:12345-192.168.203.36@tcp:101: 00010000:00010000:2.0:1783137445.589343:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137445.589361:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72686 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137445.589389:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72686 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137445.589401:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72686 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137445.589411:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2045c00, rc 0) 00000100:00100000:2.0:1783137445.589467:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+6:5557:x1869754974339328:12345-192.168.203.36@tcp:101: Request processed in 139us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137445.589473:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:3.0:1783137445.594474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137445.594506:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974339456 00000100:00100000:3.0:1783137445.594514:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974339456 00000100:00100000:3.0:1783137445.594557:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:3.0:1783137445.594566:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+6:5557:x1869754974339456:12345-192.168.203.36@tcp:501: 00000100:00100000:3.0:1783137445.596053:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+6:5557:x1869754974339456:12345-192.168.203.36@tcp:501: Request processed in 1478us (1578us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783137445.596066:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:3.0:1783137445.601681:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137445.601757:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974339584 00000100:00100000:1.0:1783137445.601774:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974339584 00000100:00100000:1.0:1783137445.601840:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:1.0:1783137445.601850:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+6:5557:x1869754974339584:12345-192.168.203.36@tcp:101: 00010000:00010000:1.0:1783137445.601866:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137445.601880:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7268d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137445.601905:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7268d expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137445.601928:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7268d expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137445.601937:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c000, rc 0) 00000100:00100000:1.0:1783137445.601991:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+7:5557:x1869754974339584:12345-192.168.203.36@tcp:101: Request processed in 143us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.601999:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:0.0:1783137445.604884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137445.605088:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974339712 00000100:00100000:3.0:1783137445.605097:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974339712 00000100:00100000:3.0:1783137445.605147:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:3.0:1783137445.605157:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+7:5557:x1869754974339712:12345-192.168.203.36@tcp:501: 00000100:00100000:3.0:1783137445.606457:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:5557:x1869754974339712:12345-192.168.203.36@tcp:501: Request processed in 1295us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137445.606469:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:1.0:1783137445.610151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137445.610364:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974339840 00000100:00100000:3.0:1783137445.610373:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974339840 00000100:00100000:3.0:1783137445.610424:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:3.0:1783137445.610434:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:5557:x1869754974339840:12345-192.168.203.36@tcp:503: 00000100:00100000:3.0:1783137445.610767:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:5557:x1869754974339840:12345-192.168.203.36@tcp:503: Request processed in 333us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137445.610775:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:0.0:1783137445.616592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137445.616666:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974339968 00000100:00100000:3.0:1783137445.616675:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974339968 00000100:00100000:3.0:1783137445.616725:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:3.0:1783137445.616734:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:5575:x1869754974339968:12345-192.168.203.36@tcp:502: 00000100:00100000:3.0:1783137445.617097:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:5575:x1869754974339968:12345-192.168.203.36@tcp:502: Request processed in 363us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137445.617105:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:0.0:1783137445.648053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137445.648089:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974340096 00000100:00100000:0.0:1783137445.648097:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974340096 00000100:00100000:0.0:1783137445.648143:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:0.0:1783137445.648152:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:5575:x1869754974340096:12345-192.168.203.36@tcp:502: 00000100:00100000:0.0:1783137445.648421:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:5575:x1869754974340096:12345-192.168.203.36@tcp:502: Request processed in 268us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137445.648429:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:2.0:1783137445.660609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137445.660671:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974340224 00000100:00100000:2.0:1783137445.660682:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974340224 00000100:00100000:2.0:1783137445.660729:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:2.0:1783137445.660739:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:5557:x1869754974340224:12345-192.168.203.36@tcp:101: 00010000:00010000:2.0:1783137445.660755:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137445.660771:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709c2045400/0x88def104ac674912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec726b7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137445.660923:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709c2045400/0x88def104ac674912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726b7 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137445.660935:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709c2045400/0x88def104ac674912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726b7 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137445.660956:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709c2045400, rc 0) 00000100:00100000:2.0:1783137445.661011:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5557:x1869754974340224:12345-192.168.203.36@tcp:101: Request processed in 274us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137445.661017:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:2.0:1783137445.669907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137445.670010:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974340352 00000100:00100000:3.0:1783137445.670019:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974340352 00000100:00100000:3.0:1783137445.670084:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:3.0:1783137445.670095:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5557:x1869754974340352:12345-192.168.203.36@tcp:256: 20000000:01000000:3.0:1783137445.670131:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783137445.670154:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783137445.670157:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783137445.670161:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783137445.670163:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1783137445.683060:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5557:x1869754974340352:12345-192.168.203.36@tcp:256: Request processed in 12955us (13151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.683074:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:3.0:1783137445.687016:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137445.687358:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974340480 00000100:00100000:1.0:1783137445.687367:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974340480 00000100:00100000:1.0:1783137445.687427:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 123 00000100:00100000:1.0:1783137445.687437:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5557:x1869754974340480:12345-192.168.203.36@tcp:101: 00010000:00010000:1.0:1783137445.687452:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137445.687470:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec726be expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137445.687499:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726be expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137445.687511:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726be expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137445.687520:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d000, rc 0) 00000100:00100000:1.0:1783137445.687574:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5557:x1869754974340480:12345-192.168.203.36@tcp:101: Request processed in 138us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.687594:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 123 00000100:00100000:3.0:1783137445.689660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137445.689751:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974340608 00000100:00100000:1.0:1783137445.689768:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974340608 00000100:00100000:1.0:1783137445.689854:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:1.0:1783137445.689865:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5557:x1869754974340608:12345-192.168.203.36@tcp:501: 00000100:00100000:1.0:1783137445.690157:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5557:x1869754974340608:12345-192.168.203.36@tcp:501: Request processed in 294us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.690166:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:3.0:1783137445.696838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137445.696910:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974340736 00000100:00100000:2.0:1783137445.696919:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974340736 00000100:00100000:2.0:1783137445.696972:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 125 00000100:00100000:2.0:1783137445.696981:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5557:x1869754974340736:12345-192.168.203.36@tcp:503: 00000100:00100000:2.0:1783137445.697354:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5557:x1869754974340736:12345-192.168.203.36@tcp:503: Request processed in 372us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137445.697363:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 125 00000100:00100000:1.0:1783137445.704995:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137445.705046:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974340864 00000100:00100000:1.0:1783137445.705055:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974340864 00000100:00100000:1.0:1783137445.705102:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:1.0:1783137445.705111:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5578:x1869754974340864:12345-192.168.203.36@tcp:502: 00000100:00100000:1.0:1783137445.705351:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5578:x1869754974340864:12345-192.168.203.36@tcp:502: Request processed in 239us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.705360:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:3.0:1783137445.715655:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137445.715884:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974340992 00000100:00100000:1.0:1783137445.715894:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974340992 00000100:00100000:1.0:1783137445.715955:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:1.0:1783137445.715965:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5578:x1869754974340992:12345-192.168.203.36@tcp:502: 00000100:00100000:1.0:1783137445.716388:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5578:x1869754974340992:12345-192.168.203.36@tcp:502: Request processed in 423us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.716397:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:3.0:1783137445.725831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137445.727341:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974341120 00000100:00100000:1.0:1783137445.727356:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974341120 00000100:00100000:1.0:1783137445.727429:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:1.0:1783137445.727437:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1869754974341120:12345-192.168.203.36@tcp:38: 00010000:00080000:1.0:1783137445.727467:0:7113:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1783137445.727515:0:7113:0:(genops.c:1406:class_connect()) connect: client d717cef4-1367-4dd9-ae68-a0c1ee666834, cookie 0x88def104ac674920 00000004:00100000:1.0:1783137445.727547:0:7113:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1783137445.727554:0:7113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1783137445.764613:0:7113:0:(import.c:65:import_set_state_nolock()) ffff970997f3e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783137445.764701:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2350:x1869754974341120:12345-192.168.203.36@tcp:38: Request processed in 37263us (39017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.764712:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:2.0:1783137445.799699:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990092032:0@lo:400: 00000100:00100000:2.0:1783137445.799776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137445.799847:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137445.799852:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990092160:0@lo:400: 00000100:00100000:2.0:1783137445.799876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137445.799909:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990092032 00000100:00100000:2.0:1783137445.799915:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990092032 00000100:00100000:2.0:1783137445.799958:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783137445.799965:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990092032:12345-0@lo:400: 00000100:00100000:2.0:1783137445.800006:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990092032:12345-0@lo:400: Request processed in 42us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137445.800013:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783137445.800044:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990092160 00000100:00100000:2.0:1783137445.800058:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990092160 00000100:00100000:2.0:1783137445.800080:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137445.800086:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990092160:12345-0@lo:400: 00000100:00100000:2.0:1783137445.800114:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990092160:12345-0@lo:400: Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137445.800120:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1783137445.800135:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783137445.800139:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783137445.800165:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd018000 x1869754990092160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137445.800178:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990092160:0@lo:400: 00010000:00080000:2.0:1783137445.800188:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd01a680 x1869754990092032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137445.800197:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990092032:0@lo:400: 00000100:00100000:1.0:1783137445.800351:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990091776:0@lo:400: 00000100:00100000:1.0:1783137445.800381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137445.800410:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990092288:0@lo:400: 00000100:00100000:1.0:1783137445.800428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137445.800440:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783137445.800445:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990091904:0@lo:400: 00000100:00100000:1.0:1783137445.800460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137445.800472:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990092416:0@lo:400: 00000100:00100000:1.0:1783137445.800488:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137445.800510:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990092416 00000100:00100000:1.0:1783137445.800513:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990092416 00000100:00100000:1.0:1783137445.800543:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137445.800550:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990092416:12345-0@lo:400: 00000100:00100000:1.0:1783137445.800586:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990092416:12345-0@lo:400: Request processed in 36us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.800592:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783137445.800614:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990092288 00000100:00100000:1.0:1783137445.800617:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990092288 00000100:00100000:1.0:1783137445.800635:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990091904 00000100:00100000:1.0:1783137445.800637:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990091904 00000100:00100000:1.0:1783137445.800649:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783137445.800654:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990092288:12345-0@lo:400: 00000100:00100000:1.0:1783137445.800682:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990092288:12345-0@lo:400: Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.800688:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783137445.800699:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783137445.800704:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990091904:12345-0@lo:400: 00000100:00100000:1.0:1783137445.800727:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990091904:12345-0@lo:400: Request processed in 23us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137445.800733:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1783137445.800746:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783137445.800749:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783137445.800777:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd01b100 x1869754990091904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137445.800786:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990091904:0@lo:400: 00010000:00080000:1.0:1783137445.800818:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd018700 x1869754990092416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137445.800825:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783137445.800834:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990092416:0@lo:400: 00010000:00080000:1.0:1783137445.800842:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd018a80 x1869754990092288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137445.800849:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990092288:0@lo:400: 00000100:00100000:2.0:1783137445.801519:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990091776 00000100:00100000:2.0:1783137445.801526:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990091776 00000100:00100000:2.0:1783137445.801562:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783137445.801569:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990091776:12345-0@lo:400: 00000100:00100000:2.0:1783137445.801615:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990091776:12345-0@lo:400: Request processed in 46us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137445.801621:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783137445.801732:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990091776:0@lo:400: 00000100:00100000:3.0:1783137446.311049:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137446.311096:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990092544:0@lo:13: 00000100:00100000:3.0:1783137446.311190:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137446.311342:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990092544 00000100:00100000:0.0:1783137446.311350:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990092544 00000100:00100000:0.0:1783137446.311415:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783137446.311425:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990092544:12345-0@lo:13: 00002000:00000024:0.0:1783137446.311472:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137446.311770:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990092544:12345-0@lo:13: Request processed in 346us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137446.311778:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783137446.313602:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd922300 x1869754990092544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137446.313628:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990092544:0@lo:13: 00010000:00010000:2.0:1783137446.375668:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137446.774069:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137446.774248:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974341376 00000100:00100000:2.0:1783137446.774259:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974341376 00000100:00100000:2.0:1783137446.778992:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:2.0:1783137446.779032:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5557:x1869754974341376:12345-192.168.203.36@tcp:41: 00000004:00000024:2.0:1783137446.779102:0:7113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1783137446.779196:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5557:x1869754974341376:12345-192.168.203.36@tcp:41: Request processed in 190us (5145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137446.779204:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00080000:1.0:1783137446.780874:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137446.783593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137446.783885:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974341248 00000100:00100000:1.0:1783137446.783895:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974341248 00000100:00100000:1.0:1783137446.783988:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:1.0:1783137446.784000:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:0:x1869754974341248:12345-192.168.203.36@tcp:41: 00000004:00000024:1.0:1783137446.784040:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783137446.784121:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:0:x1869754974341248:12345-192.168.203.36@tcp:41: Request processed in 117us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137446.784128:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:0.0:1783137446.786892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137446.787084:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974341504 00000100:00100000:3.0:1783137446.787094:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974341504 00000100:00100000:3.0:1783137446.787149:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:3.0:1783137446.787158:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5557:x1869754974341504:12345-192.168.203.36@tcp:40: 00000100:00100000:3.0:1783137446.787336:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5557:x1869754974341504:12345-192.168.203.36@tcp:40: Request processed in 174us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137446.787344:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:3.0:1783137446.792928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137446.792975:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137446.793010:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137446.793056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137446.793084:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974341632 00000100:00100000:3.0:1783137446.793093:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974341632 00000100:00100000:3.0:1783137446.793122:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974341760 00000100:00100000:3.0:1783137446.793125:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974341760 00000100:00100000:3.0:1783137446.793140:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:3.0:1783137446.793147:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1869754974341632:12345-192.168.203.36@tcp:8: 00010000:00080000:3.0:1783137446.793182:0:6618:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1783137446.793209:0:6618:0:(genops.c:1406:class_connect()) connect: client d717cef4-1367-4dd9-ae68-a0c1ee666834, cookie 0x88def104ac674927 00002000:00100000:3.0:1783137446.793221:0:6618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d717cef4-1367-4dd9-ae68-a0c1ee666834/ffff9709b7c75000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1783137446.793548:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974341888 00000100:00100000:1.0:1783137446.793553:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974341888 00000100:00100000:1.0:1783137446.793589:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:1.0:1783137446.793596:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5557:x1869754974341888:12345-192.168.203.36@tcp:33: 00002000:00100000:3.0:1783137446.794339:0:6618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783137446.795755:0:6618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783137446.795818:0:6618:0:(import.c:65:import_set_state_nolock()) ffff9709b7c71800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137446.795879:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2350:x1869754974341632:12345-192.168.203.36@tcp:8: Request processed in 2731us (2867us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137446.795889:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:3.0:1783137446.795914:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:3.0:1783137446.795920:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1869754974341760:12345-192.168.203.36@tcp:8: 00010000:00080000:3.0:1783137446.795941:0:6618:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1783137446.795962:0:6618:0:(genops.c:1406:class_connect()) connect: client d717cef4-1367-4dd9-ae68-a0c1ee666834, cookie 0x88def104ac67492e 00002000:00100000:3.0:1783137446.795972:0:6618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d717cef4-1367-4dd9-ae68-a0c1ee666834/ffff9709b7c70000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783137446.795980:0:6618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783137446.796087:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974342016 00000100:00100000:2.0:1783137446.796095:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974342016 00000100:00100000:2.0:1783137446.796146:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 129 00000100:00100000:2.0:1783137446.796156:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2352:x1869754974342016:12345-192.168.203.36@tcp:400: 00000100:00100000:2.0:1783137446.796194:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2352:x1869754974342016:12345-192.168.203.36@tcp:400: Request processed in 40us (3217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137446.796201:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 129 00002000:00080000:3.0:1783137446.797958:0:6618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783137446.797996:0:6618:0:(import.c:65:import_set_state_nolock()) ffff9709b7c74800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137446.798064:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2350:x1869754974341760:12345-192.168.203.36@tcp:8: Request processed in 2142us (5006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137446.798074:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000004:00080000:2.0:1783137446.828155:0:5817:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34497us 00000100:00100000:2.0:1783137446.828834:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137446.828856:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990092672:0@lo:13: 00000100:00100000:2.0:1783137446.828922:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137446.829200:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990092672 00000100:00100000:3.0:1783137446.829208:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990092672 00000100:00100000:3.0:1783137446.829325:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783137446.829744:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd01a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990092672:12345-0@lo:13: 00002000:00000024:3.0:1783137446.829932:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137446.830777:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd01a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990092672:12345-0@lo:13: Request processed in 1440us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137446.830788:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783137446.837037:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970986661c00 x1869754990092672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137446.837063:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990092672:0@lo:13: 00000004:00200000:2.0:1783137446.845287:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783137446.845460:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5557:x1869754974341888:12345-192.168.203.36@tcp:33: Request processed in 51858us (52537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137446.845476:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:0.0:1783137447.071752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137447.074065:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974342144 00000100:00100000:3.0:1783137447.074081:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974342144 00000100:00100000:1.0:1783137447.074674:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:1.0:1783137447.074689:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5595:x1869754974342144:12345-192.168.203.36@tcp:101: 00010000:00010000:1.0:1783137447.074710:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137447.074737:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674935 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec726e8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137447.074820:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac67493c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137447.074847:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac67493c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137447.074861:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac67493c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137447.075075:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783137447.075080:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137447.075176:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac67493c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137447.075202:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726e8 expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137447.075219:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac67493c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726e8 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137447.075240:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51c00) 00010000:00010000:1.0:1783137447.075242:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137447.075245:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d400, rc 0) 00000100:00100000:1.0:1783137447.075313:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:5595:x1869754974342144:12345-192.168.203.36@tcp:101: Request processed in 628us (3572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137447.075320:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00010000:00010000:0.0:1783137447.399422:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137448.424480:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137449.137363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137449.137498:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974342272 00000100:00100000:1.0:1783137449.137507:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974342272 00000100:00100000:1.0:1783137449.137624:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:1.0:1783137449.137648:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:5648:x1869754974342272:12345-192.168.203.36@tcp:41: 00000004:00000024:1.0:1783137449.137719:0:7113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783137449.137905:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:5648:x1869754974342272:12345-192.168.203.36@tcp:41: Request processed in 271us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137449.137913:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00080000:2.0:1783137449.139433:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137449.143815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137449.143907:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974342400 00000100:00100000:1.0:1783137449.143918:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974342400 00000100:00100000:1.0:1783137449.143987:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:1.0:1783137449.144007:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5648:x1869754974342400:12345-192.168.203.36@tcp:13: 00002000:00000024:1.0:1783137449.144045:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137449.144129:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5648:x1869754974342400:12345-192.168.203.36@tcp:13: Request processed in 128us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137449.144136:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00080000:2.0:1783137449.144199:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137449.150272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137449.150771:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974342528 00000100:00100000:1.0:1783137449.150781:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974342528 00000100:00100000:1.0:1783137449.150921:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1783137449.150932:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5648:x1869754974342528:12345-192.168.203.36@tcp:13: 00002000:00000024:1.0:1783137449.150968:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137449.151049:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:5648:x1869754974342528:12345-192.168.203.36@tcp:13: Request processed in 118us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137449.151057:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00080000:2.0:1783137449.154966:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1783137449.438144:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00010000:00010000:0.0:1783137449.446944:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137450.470999:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137450.919945:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990092800:0@lo:400: 00000100:00100000:1.0:1783137450.920034:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137450.920730:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990092800 00000100:00100000:2.0:1783137450.920738:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990092800 00000100:00100000:2.0:1783137450.920814:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783137450.920826:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990092800:12345-0@lo:400: 00000100:00100000:2.0:1783137450.920889:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990092800:12345-0@lo:400: Request processed in 66us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137450.920898:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783137450.920933:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990093184:0@lo:400: 00000100:00100000:2.0:1783137450.920964:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137450.921004:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990093056:0@lo:400: 00000100:00100000:2.0:1783137450.921052:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137450.921075:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990092928:0@lo:400: 00000100:00100000:2.0:1783137450.921095:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137450.921118:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990093184 00000100:00100000:2.0:1783137450.921122:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990093184 00000100:00100000:2.0:1783137450.921155:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137450.921161:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990093184:12345-0@lo:400: 00000100:00100000:2.0:1783137450.921193:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990093184:12345-0@lo:400: Request processed in 33us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137450.921199:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137450.921216:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990093056 00000100:00100000:2.0:1783137450.921219:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990093056 00000100:00100000:2.0:1783137450.921241:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990092928 00000100:00100000:2.0:1783137450.921244:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990092928 00000100:00100000:2.0:1783137450.921266:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783137450.921273:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990093056:12345-0@lo:400: 00000100:00100000:2.0:1783137450.921306:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990093056:12345-0@lo:400: Request processed in 34us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137450.921313:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783137450.921331:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783137450.921336:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990092928:12345-0@lo:400: 00000100:00100000:2.0:1783137450.921382:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990092928:12345-0@lo:400: Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137450.921389:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1783137450.921406:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783137450.921410:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137450.926444:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990092800:0@lo:400: 00000100:00100000:1.0:1783137450.926460:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990093312:0@lo:400: 00000100:00100000:1.0:1783137450.926517:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783137450.926577:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd921c00 x1869754990093184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137450.926590:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990093184:0@lo:400: 00000100:00100000:1.0:1783137450.926634:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990093056:0@lo:400: 00000100:00100000:1.0:1783137450.926663:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990092928:0@lo:400: 00000100:00100000:1.0:1783137450.926670:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990093440:0@lo:400: 00000100:00100000:1.0:1783137450.926703:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137450.928081:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990093440 00000100:00100000:3.0:1783137450.928091:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990093440 00000100:00100000:3.0:1783137450.928147:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783137450.928156:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990093440:12345-0@lo:400: 00000100:00100000:3.0:1783137450.928220:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990093440:12345-0@lo:400: Request processed in 65us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137450.928227:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1783137450.928478:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783137450.928582:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc35ce00 x1869754990093440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137450.928596:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990093440:0@lo:400: 00000100:00100000:1.0:1783137450.929345:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990093312 00000100:00100000:1.0:1783137450.929352:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990093312 00000100:00100000:1.0:1783137450.929394:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783137450.929402:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990093312:12345-0@lo:400: 00000100:00100000:1.0:1783137450.929449:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990093312:12345-0@lo:400: Request processed in 48us (2932us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137450.929457:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1783137450.929482:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137450.929510:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990093312:0@lo:400: 00000001:00100000:3.0:1783137450.977167:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000001:00100000:2.0:1783137450.997438:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000100:00100000:3.0:1783137451.431139:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137451.431162:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990093568:0@lo:13: 00000100:00100000:3.0:1783137451.431229:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137451.431390:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990093568 00000100:00100000:2.0:1783137451.431399:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990093568 00000100:00100000:2.0:1783137451.431451:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783137451.431462:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990093568:12345-0@lo:13: 00002000:00000024:2.0:1783137451.431495:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137451.431564:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990093568:12345-0@lo:13: Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137451.431571:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1783137451.435404:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd018700 x1869754990093568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137451.435430:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990093568:0@lo:13: 00010000:00010000:0.0:1783137451.495887:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783137451.600657:0:8188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1783137451.829756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137451.830336:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974342656 00000100:00100000:2.0:1783137451.830346:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974342656 00000100:00100000:2.0:1783137451.830404:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:2.0:1783137451.830415:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2351:x1869754974342656:12345-192.168.203.36@tcp:400: 00000100:00100000:2.0:1783137451.830491:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2351:x1869754974342656:12345-192.168.203.36@tcp:400: Request processed in 77us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137451.830498:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:0.0:1783137451.831408:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137451.831462:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137451.831498:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137451.831520:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974342784 00000100:00100000:1.0:1783137451.831527:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974342784 00000100:00080000:0.0:1783137451.831564:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137451.831584:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:1.0:1783137451.831593:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974342784:12345-192.168.203.36@tcp:400: 00000100:00100000:1.0:1783137451.831646:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974342784:12345-192.168.203.36@tcp:400: Request processed in 54us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137451.831650:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974342912 00000100:00100000:1.0:1783137451.831653:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:2.0:1783137451.831654:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974342912 00000100:00100000:2.0:1783137451.831693:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974343040 00000100:00100000:2.0:1783137451.831696:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974343040 00000100:00100000:1.0:1783137451.831696:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:1.0:1783137451.831703:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974342912:12345-192.168.203.36@tcp:400: 00000100:00100000:2.0:1783137451.831737:0:6619:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783137451.831737:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974342912:12345-192.168.203.36@tcp:400: Request processed in 34us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137451.831743:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:2.0:1783137451.831744:0:6619:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1783137451.831756:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:1.0:1783137451.831762:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974343040:12345-192.168.203.36@tcp:400: 00000100:00100000:1.0:1783137451.831786:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974343040:12345-192.168.203.36@tcp:400: Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137451.831819:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00080000:0.0:1783137451.832617:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137451.832622:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137451.943085:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137451.943109:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990093696:0@lo:13: 00000100:00100000:2.0:1783137451.943190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137451.946674:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990093696 00000100:00100000:3.0:1783137451.946688:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990093696 00000100:00100000:3.0:1783137451.947311:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137451.947324:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd01b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990093696:12345-0@lo:13: 00002000:00000024:3.0:1783137451.947361:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137451.947454:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd01b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990093696:12345-0@lo:13: Request processed in 133us (4263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137451.947461:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1783137451.947550:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970986662300 x1869754990093696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137451.947570:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990093696:0@lo:13: 00010000:00010000:1.0:1783137452.520992:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137453.543277:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137454.567324:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783137455.042065:0:8336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebf41f270 20000000:00000080:2.0:1783137455.042383:0:8336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9709b7e98800 uarg=0000000000000000 20000000:01000000:2.0:1783137455.042417:0:8336:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783137455.042420:0:8336:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783137455.042422:0:8336:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783137455.042426:0:8336:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783137455.042431:0:8336:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783137455.043156:0:8336:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783137455.043162:0:8336:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783137455.043384:0:8336:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783137455.043387:0:8336:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783137455.048082:0:8337:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1783137455.048639:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1783137455.048706:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1783137455.048746:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1783137455.048758:0:8336:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783137455.048761:0:8336:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783137455.052084:0:8338:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1783137455.052682:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1783137455.052752:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1783137455.052947:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1783137455.054584:0:8336:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783137455.054589:0:8336:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783137455.055619:0:8339:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1783137455.056263:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1783137455.056308:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1783137455.056350:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1783137455.056362:0:8336:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783137455.056364:0:8336:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783137455.057612:0:8340:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1783137455.058071:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1783137455.058117:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1783137455.058152:0:8336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1783137455.058422:0:8336:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783137455.058444:0:8336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058461:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674839 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058470:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674863 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058478:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67488d expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058485:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67489b expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058500:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6748a9 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058509:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6748c5 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058516:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6748ef expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058525:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72686 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058532:0:8336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7268d expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058540:0:8336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058577:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7268d expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058592:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7268d expref: 9 pid: 5809 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137455.058607:0:8336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985320e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990093824:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137455.058756:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72686 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058764:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72686 expref: 9 pid: 5807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137455.058780:0:8336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985321500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990093952:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137455.058838:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6748ef expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.058846:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6748ef expref: 18 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137455.058854:0:8336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985321880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094080:0@lo:104: 00000100:00100000:0.0:1783137455.058893:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783137455.058994:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6748c5 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.059002:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6748c5 expref: 18 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137455.059010:0:8336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985322680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094208:0@lo:104: 00000100:00100000:0.0:1783137455.059031:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783137455.064570:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6748a9 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137455.064588:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6748a9 expref: 18 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.064614:0:8336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094336:0@lo:104: 00010000:00010000:1.0:1783137455.064665:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac67489b expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137455.064674:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac67489b expref: 18 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.064682:0:8336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094464:0@lo:104: 00010000:00010000:1.0:1783137455.064718:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac67488d expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137455.064725:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac67488d expref: 18 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.064732:0:8336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094592:0@lo:104: 00010000:00010000:1.0:1783137455.064751:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac674863 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137455.064758:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac674863 expref: 18 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.064766:0:8336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094720:0@lo:104: 00010000:00010000:1.0:1783137455.064786:0:8336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac674839 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137455.064817:0:8336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac674839 expref: 18 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.064839:0:8336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094848:0@lo:104: 00000100:00100000:1.0:1783137455.064864:0:8336:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214840 going to sleep for 11 seconds 00000100:00100000:3.0:1783137455.066025:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783137455.066060:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.066089:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.066099:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.066121:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.066133:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.066143:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990094080 00000100:00100000:3.0:1783137455.066150:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990094080 00000100:00100000:3.0:1783137455.067137:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990094208 00000100:00100000:3.0:1783137455.067144:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990094208 00000100:00100000:3.0:1783137455.067162:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990094336 00000100:00100000:3.0:1783137455.067165:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990094336 00000100:00100000:3.0:1783137455.067174:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990094464 00000100:00100000:3.0:1783137455.067176:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990094464 00000100:00100000:3.0:1783137455.067185:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990094592 00000100:00100000:3.0:1783137455.067187:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990094592 00000100:00100000:3.0:1783137455.067195:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990094720 00000100:00100000:3.0:1783137455.067198:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990094720 00000100:00100000:3.0:1783137455.067206:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990094848 00000100:00100000:3.0:1783137455.067209:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990094848 00000100:00100000:3.0:1783137455.067224:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137455.067232:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+9:8336:x1869754990094080:12345-0@lo:104: 00010000:00010000:3.0:1783137455.067249:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067337:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137455.067343:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+9:8336:x1869754990094080:12345-0@lo:104: Request processed in 112us (8451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.067350:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137455.067369:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137455.067375:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+8:8336:x1869754990094208:12345-0@lo:104: 00010000:00010000:3.0:1783137455.067383:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067436:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783137455.067441:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+8:8336:x1869754990094208:12345-0@lo:104: Request processed in 67us (8410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.067446:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137455.067476:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137455.067481:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+7:8336:x1869754990094336:12345-0@lo:104: 00010000:00010000:3.0:1783137455.067488:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067511:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783137455.067516:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+7:8336:x1869754990094336:12345-0@lo:104: Request processed in 35us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.067522:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137455.067533:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783137455.067538:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+6:8336:x1869754990094464:12345-0@lo:104: 00010000:00010000:3.0:1783137455.067544:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067567:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783137455.067572:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+6:8336:x1869754990094464:12345-0@lo:104: Request processed in 35us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.067577:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783137455.067586:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137455.067591:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+5:8336:x1869754990094592:12345-0@lo:104: 00010000:00010000:3.0:1783137455.067597:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067627:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1783137455.067631:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+5:8336:x1869754990094592:12345-0@lo:104: Request processed in 40us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.067636:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137455.067649:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783137455.067653:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:8336:x1869754990094720:12345-0@lo:104: 00010000:00010000:3.0:1783137455.067660:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067685:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1783137455.067689:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:8336:x1869754990094720:12345-0@lo:104: Request processed in 36us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.067694:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783137455.067705:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783137455.067711:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:8336:x1869754990094848:12345-0@lo:104: 00010000:00010000:3.0:1783137455.067718:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067742:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1783137455.067746:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:8336:x1869754990094848:12345-0@lo:104: Request processed in 37us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.067751:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1783137455.067770:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1783137455.067775:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067781:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970981488e00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137455.067816:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067825:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137455.067833:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137455.067839:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137455.067869:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067875:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137455.067893:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067899:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970981488e00/0x88def104ac6748ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067913:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783137455.067916:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067922:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2172a00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137455.067925:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067931:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137455.067946:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137455.067951:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137455.067977:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067983:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137455.067988:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.067994:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2172a00/0x88def104ac6748c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748cc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068003:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783137455.068006:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068011:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2045a00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137455.068013:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068019:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137455.068025:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137455.068029:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137455.068047:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068052:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137455.068067:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068073:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2045a00/0x88def104ac6748a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748b0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068081:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783137455.068084:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068090:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980030000 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137455.068092:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068098:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137455.068103:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137455.068107:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137455.068117:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068123:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137455.068126:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068140:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970980030000/0x88def104ac67489b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6748a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068149:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783137455.068152:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068157:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970981489600 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137455.068160:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068167:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137455.068174:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137455.068178:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137455.068189:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068194:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137455.068198:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068205:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970981489600/0x88def104ac67488d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068213:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783137455.068220:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068225:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2045e00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137455.068228:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068234:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137455.068240:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137455.068245:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137455.068258:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068263:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137455.068267:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068273:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2045e00/0x88def104ac674863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac67486a expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068280:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137455.068283:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068288:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980030c00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137455.068290:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068306:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137455.068311:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137455.068316:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137455.068326:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068330:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137455.068334:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068339:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970980030c00/0x88def104ac674839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674840 expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068351:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137455.068353:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137455.068354:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137455.068368:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990094976:0@lo:103: 00000100:00100000:3.0:1783137455.068403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.068434:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990095488:0@lo:103: 00000100:00100000:3.0:1783137455.068452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.068471:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783137455.068476:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990095104:0@lo:103: 00000100:00100000:3.0:1783137455.068493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.068507:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990095616:0@lo:103: 00000100:00100000:3.0:1783137455.068534:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.068556:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990095232:0@lo:103: 00000100:00100000:3.0:1783137455.068574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.068583:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990095744:0@lo:103: 00000100:00100000:3.0:1783137455.068598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.068607:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137455.068611:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990095360:0@lo:103: 00000100:00100000:3.0:1783137455.068628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137455.068654:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990094976 00000100:00100000:3.0:1783137455.068660:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990094976 00010000:00010000:3.0:1783137455.068680:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6748ef expref: 19 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137455.068694:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990095488 00000100:00100000:3.0:1783137455.068696:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990095488 00010000:00010000:3.0:1783137455.068706:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67488d expref: 20 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137455.068715:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990095104 00000100:00100000:3.0:1783137455.068717:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990095104 00010000:00010000:3.0:1783137455.068728:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6748c5 expref: 21 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137455.068736:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990095616 00000100:00100000:3.0:1783137455.068737:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990095616 00010000:00010000:3.0:1783137455.068745:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674863 expref: 22 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137455.068752:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990095232 00000100:00100000:3.0:1783137455.068754:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990095232 00010000:00010000:3.0:1783137455.068770:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6748a9 expref: 23 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137455.068780:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990095744 00000100:00100000:3.0:1783137455.068782:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990095744 00010000:00010000:3.0:1783137455.068811:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674839 expref: 24 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137455.068822:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990095360 00000100:00100000:3.0:1783137455.068824:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990095360 00010000:00010000:3.0:1783137455.068834:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67489b expref: 25 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137455.068846:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137455.068852:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+25:3308:x1869754990094976:12345-0@lo:103: 00010000:00010000:3.0:1783137455.068862:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137455.068867:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6748ef expref: 25 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068874:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6748ef expref: 25 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068887:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137455.068917:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+25:3308:x1869754990094976:12345-0@lo:103: Request processed in 65us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.068922:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137455.068935:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137455.068940:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+24:3308:x1869754990095488:12345-0@lo:103: 00010000:00010000:3.0:1783137455.068947:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137455.068951:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67488d expref: 24 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068979:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac67488d expref: 24 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.068988:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137455.069010:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+24:3308:x1869754990095488:12345-0@lo:103: Request processed in 70us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.069016:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137455.069027:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137455.069031:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+23:3308:x1869754990095104:12345-0@lo:103: 00010000:00010000:3.0:1783137455.069039:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137455.069042:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6748c5 expref: 23 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069049:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6748c5 expref: 23 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069058:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137455.069077:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+23:3308:x1869754990095104:12345-0@lo:103: Request processed in 46us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.069083:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137455.069096:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783137455.069101:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf236d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+22:3308:x1869754990095616:12345-0@lo:103: 00010000:00010000:3.0:1783137455.069109:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137455.069113:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674863 expref: 22 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069120:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac674863 expref: 22 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069136:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137455.069160:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf236d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+22:3308:x1869754990095616:12345-0@lo:103: Request processed in 59us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.069166:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783137455.069179:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137455.069184:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+21:3306:x1869754990095232:12345-0@lo:103: 00010000:00010000:3.0:1783137455.069190:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137455.069195:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6748a9 expref: 21 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069202:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6748a9 expref: 21 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069211:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137455.069235:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+21:3306:x1869754990095232:12345-0@lo:103: Request processed in 51us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.069240:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137455.069250:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783137455.069255:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+20:3306:x1869754990095744:12345-0@lo:103: 00010000:00010000:3.0:1783137455.069261:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137455.069265:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674839 expref: 20 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069271:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac674839 expref: 20 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069279:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137455.069304:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+20:3306:x1869754990095744:12345-0@lo:103: Request processed in 49us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.069310:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783137455.069322:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783137455.069328:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990095360:12345-0@lo:103: 00010000:00010000:3.0:1783137455.069335:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137455.069340:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67489b expref: 19 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069346:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac67489b expref: 19 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.069354:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137455.069373:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990095360:12345-0@lo:103: Request processed in 46us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137455.069378:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783137455.069429:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990095360:0@lo:103: 00000100:00100000:3.0:1783137455.069439:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990095232:0@lo:103: 00000100:00100000:3.0:1783137455.069445:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990095744:0@lo:103: 00000100:00100000:3.0:1783137455.069473:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990095104:0@lo:103: 00000100:00100000:3.0:1783137455.069480:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990095616:0@lo:103: 00000100:00100000:3.0:1783137455.069485:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990094976:0@lo:103: 00000100:00100000:3.0:1783137455.069492:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990095488:0@lo:103: 00010000:00010000:1.0:1783137455.072137:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488c00/0x88def104ac6748f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6748ef expref: 18 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.072159:0:8336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985321880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094080:0@lo:104: 00010000:00010000:1.0:1783137455.072171:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2173a00/0x88def104ac6748cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6748c5 expref: 17 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.072187:0:8336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985322680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094208:0@lo:104: 00010000:00010000:1.0:1783137455.072199:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2172400/0x88def104ac6748b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6748a9 expref: 16 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.072208:0:8336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094336:0@lo:104: 00010000:00010000:1.0:1783137455.072217:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2044600/0x88def104ac6748a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac67489b expref: 15 pid: 5807 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.072226:0:8336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094464:0@lo:104: 00010000:00010000:1.0:1783137455.072235:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2045000/0x88def104ac674894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac67488d expref: 14 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.072243:0:8336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094592:0@lo:104: 00010000:00010000:1.0:1783137455.072251:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970980031800/0x88def104ac67486a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac674863 expref: 13 pid: 5808 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.072258:0:8336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094720:0@lo:104: 00010000:00010000:1.0:1783137455.072267:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2172600/0x88def104ac674840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac674839 expref: 12 pid: 5809 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137455.072292:0:8336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990094848:0@lo:104: 00000100:00100000:0.0:1783137455.072645:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137455.072678:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1783137455.072698:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137455.072719:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974343296 00000100:00100000:0.0:1783137455.072726:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974343296 00010000:00010000:0.0:1783137455.072757:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72686 expref: 10 pid: 5807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137455.072777:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974343168 00000100:00100000:0.0:1783137455.072780:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974343168 00010000:00010000:0.0:1783137455.072814:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7268d expref: 11 pid: 5809 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137455.072839:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:0.0:1783137455.072848:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:2352:x1869754974343296:12345-192.168.203.36@tcp:103: 00010000:00010000:0.0:1783137455.072862:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137455.072868:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72686 expref: 11 pid: 5807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.072877:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72686 expref: 11 pid: 5807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.072895:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137455.072943:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:2352:x1869754974343296:12345-192.168.203.36@tcp:103: Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137455.072952:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:0.0:1783137455.072982:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1783137455.072989:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985323800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2352:x1869754974343168:12345-192.168.203.36@tcp:103: 00010000:00010000:0.0:1783137455.072996:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137455.073000:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7268d expref: 10 pid: 5809 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073008:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7268d expref: 10 pid: 5809 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073019:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073026:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073045:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073051:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073057:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073062:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073067:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137455.073071:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073077:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073084:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137455.073092:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137455.073110:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985323800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2352:x1869754974343168:12345-192.168.203.36@tcp:103: Request processed in 122us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137455.073116:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:2.0:1783137455.073206:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1783137455.073412:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709afd0c000/0x88def104ac67490b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7268d expref: 9 pid: 5809 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137455.073433:0:8336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985320e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990093824:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137455.073445:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2045c00/0x88def104ac674904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72686 expref: 8 pid: 5807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137455.073452:0:8336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985321500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8336:1869754990093952:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137455.073480:0:8336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.073489:0:8336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.073495:0:8336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.073501:0:8336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970980031000/0x88def104ac674943 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137455.595389:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137456.039859:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990096000:0@lo:400: 00000100:00100000:2.0:1783137456.039930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137456.040013:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990096512:0@lo:400: 00000100:00100000:2.0:1783137456.040050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137456.040080:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137456.040088:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990096128:0@lo:400: 00000100:00100000:1.0:1783137456.040114:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990096512 00000100:00100000:2.0:1783137456.040122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.040124:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990096512 00000100:00100000:2.0:1783137456.040166:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990096000 00000100:00100000:2.0:1783137456.040171:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990096000 00000100:00100000:1.0:1783137456.040192:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783137456.040202:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990096512:12345-0@lo:400: 00000100:00100000:1.0:1783137456.040263:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990096512:12345-0@lo:400: Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137456.040275:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783137456.040298:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990096128 00000100:00100000:1.0:1783137456.040302:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990096128 00000100:00100000:0.0:1783137456.040311:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137456.040322:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990096000:12345-0@lo:400: 00000100:00100000:0.0:1783137456.040375:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990096000:12345-0@lo:400: Request processed in 56us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137456.040387:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137456.040402:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783137456.040407:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990096128:12345-0@lo:400: 00000100:00100000:0.0:1783137456.040449:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990096128:12345-0@lo:400: Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137456.040464:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783137456.040482:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783137456.040486:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137456.040526:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990096128:0@lo:400: 00010000:00080000:0.0:1783137456.040541:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a83480 x1869754990096512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137456.040552:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990096512:0@lo:400: 00000100:00100000:0.0:1783137456.040565:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990096000:0@lo:400: 00000100:00100000:3.0:1783137456.040601:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990095872:0@lo:400: 00000100:00100000:3.0:1783137456.040639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137456.040665:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990096384:0@lo:400: 00000100:00100000:3.0:1783137456.040688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137456.040706:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137456.040712:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990096256:0@lo:400: 00000100:00100000:3.0:1783137456.040733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137456.040755:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990096256 00000100:00100000:3.0:1783137456.040759:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990096256 00000100:00100000:3.0:1783137456.040814:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783137456.040822:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990096256:12345-0@lo:400: 00000100:00100000:3.0:1783137456.040856:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990096256:12345-0@lo:400: Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.040863:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783137456.040949:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990095872 00000100:00100000:3.0:1783137456.040962:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990095872 00000100:00100000:3.0:1783137456.040992:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1783137456.040994:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137456.041001:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:3307:x1869754990095872:12345-0@lo:400: 00000100:00100000:0.0:1783137456.041007:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990096384 00000100:00100000:0.0:1783137456.041012:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990096384 00000100:00100000:3.0:1783137456.041038:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+12:3307:x1869754990095872:12345-0@lo:400: Request processed in 37us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.041046:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783137456.041051:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783137456.041060:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990096384:12345-0@lo:400: 00010000:00080000:3.0:1783137456.041092:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970985321880 x1869754990096256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137456.041102:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990096384:12345-0@lo:400: Request processed in 42us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.041107:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990096256:0@lo:400: 00000100:00100000:0.0:1783137456.041114:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783137456.041126:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990095872:0@lo:400: 00000100:00080000:0.0:1783137456.041135:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137456.041140:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990096384:0@lo:400: 10000000:01000000:0.0:1783137456.230927:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783137456.230936:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9709b7c81800 from 39 10000000:01000000:0.0:1783137456.230942:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783137456.231001:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.231023:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.231034:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137456.231056:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990096640:0@lo:101: 00000100:00100000:0.0:1783137456.231118:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.231194:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25600 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.231428:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990096640 00000100:00100000:3.0:1783137456.231436:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990096640 00000100:00100000:3.0:1783137456.231486:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783137456.231495:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+12:5811:x1869754990096640:12345-0@lo:101: 00010000:00010000:3.0:1783137456.231507:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137456.231520:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981489600/0x88def104ac674951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67494a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.231541:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981489600/0x88def104ac674951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67494a expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.231558:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981489600/0x88def104ac674951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67494a expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.231565:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981489600, rc 0) 00000100:00100000:3.0:1783137456.231614:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990096640:12345-0@lo:101: Request processed in 120us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.231621:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783137456.231839:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990096640:0@lo:101: 00010000:00010000:0.0:1783137456.231853:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.231861:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137456.231907:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990096768:0@lo:501: 00000100:00100000:0.0:1783137456.231929:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.231963:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25600 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.232009:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990096768 00000100:00100000:3.0:1783137456.232014:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990096768 00000100:00100000:3.0:1783137456.232040:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783137456.232046:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990096768:12345-0@lo:501: 00000100:00100000:3.0:1783137456.232413:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990096768:12345-0@lo:501: Request processed in 365us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.232420:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783137456.232491:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990096768:0@lo:501: 00000100:00100000:0.0:1783137456.232516:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990096896:0@lo:503: 00000100:00100000:0.0:1783137456.232549:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.232568:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25600 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.232611:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990096896 00000100:00100000:2.0:1783137456.232615:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990096896 00000100:00100000:2.0:1783137456.232646:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783137456.232653:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990096896:12345-0@lo:503: 00000100:00100000:2.0:1783137456.232786:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990096896:12345-0@lo:503: Request processed in 133us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.232810:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783137456.232942:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990096896:0@lo:503: 00000100:00100000:0.0:1783137456.233285:0:8355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8355:1869754990097024:0@lo:502: 00000100:00100000:0.0:1783137456.233313:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.233337:0:8355:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25540 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.233379:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990097024 00000100:00100000:2.0:1783137456.233383:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990097024 00000100:00100000:2.0:1783137456.233415:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783137456.233422:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:8355:x1869754990097024:12345-0@lo:502: 00000100:00100000:2.0:1783137456.233631:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:8355:x1869754990097024:12345-0@lo:502: Request processed in 208us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.233637:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783137456.234353:0:8355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8355:1869754990097024:0@lo:502: 00000100:00100000:1.0:1783137456.234400:0:8355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8355:1869754990097152:0@lo:502: 00000100:00100000:1.0:1783137456.234440:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.234512:0:8355:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a1b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.234546:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990097152 00000100:00100000:2.0:1783137456.234551:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990097152 00000100:00100000:2.0:1783137456.234585:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783137456.234592:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:8355:x1869754990097152:12345-0@lo:502: 00000100:00100000:2.0:1783137456.235101:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+13:8355:x1869754990097152:12345-0@lo:502: Request processed in 507us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.235109:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783137456.235359:0:8355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8355:1869754990097152:0@lo:502: 00000040:00080000:1.0:1783137456.235383:0:8355:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783137456.235560:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783137456.235577:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137456.235586:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.235597:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137456.235606:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783137456.235609:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1783137456.235612:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783137456.235634:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.235642:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.235650:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137456.235664:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990097280:0@lo:101: 00000100:00100000:0.0:1783137456.235902:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.235979:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.236015:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990097280 00000100:00100000:2.0:1783137456.236021:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990097280 00000100:00100000:2.0:1783137456.236092:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783137456.236100:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+13:5811:x1869754990097280:12345-0@lo:101: 00010000:00010000:2.0:1783137456.236120:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137456.236131:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd050a00/0x88def104ac67495f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674958 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137456.236171:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd050a00/0x88def104ac67495f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674958 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137456.236182:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd050a00/0x88def104ac67495f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674958 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137456.236191:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050a00, rc 0) 00000100:00100000:2.0:1783137456.236274:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990097280:12345-0@lo:101: Request processed in 174us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.236281:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783137456.236421:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990097280:0@lo:101: 00010000:00010000:0.0:1783137456.236435:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.236443:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137456.236493:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990097408:0@lo:501: 00000100:00100000:0.0:1783137456.236518:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.236574:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.236606:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990097408 00000100:00100000:2.0:1783137456.236610:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990097408 00000100:00100000:2.0:1783137456.236639:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783137456.236645:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990097408:12345-0@lo:501: 00000100:00100000:2.0:1783137456.237301:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990097408:12345-0@lo:501: Request processed in 655us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.237308:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783137456.237635:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990097408:0@lo:501: 00000100:00100000:0.0:1783137456.237772:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990097536:0@lo:503: 00000100:00100000:0.0:1783137456.237838:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137456.238009:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990097536 00000100:00100000:2.0:1783137456.238014:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990097536 00000100:00100000:0.0:1783137456.238044:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.238084:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783137456.238096:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990097536:12345-0@lo:503: 00000100:00100000:2.0:1783137456.238957:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990097536:12345-0@lo:503: Request processed in 854us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.238966:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783137456.239070:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990097536:0@lo:503: 00000100:00100000:0.0:1783137456.239613:0:8356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8356:1869754990097664:0@lo:502: 00000100:00100000:0.0:1783137456.239649:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137456.239905:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990097664 00000100:00100000:2.0:1783137456.239911:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990097664 00000100:00100000:2.0:1783137456.240034:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783137456.240042:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:8356:x1869754990097664:12345-0@lo:502: 00000100:00100000:2.0:1783137456.240226:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+14:8356:x1869754990097664:12345-0@lo:502: Request processed in 184us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.240233:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783137456.242170:0:8356:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137456.242205:0:8356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8356:1869754990097664:0@lo:502: 00000020:01000000:0.0:1783137456.242246:0:8356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137456.242255:0:8356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137456.242257:0:8356:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783137456.242262:0:8356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783137456.242295:0:8356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8356:1869754990097792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137456.242492:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137456.242556:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990097792 00000100:00100000:2.0:1783137456.242562:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990097792 00000100:00100000:0.0:1783137456.242571:0:8356:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.242631:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783137456.242642:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:8356:x1869754990097792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137456.242988:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+14:8356:x1869754990097792:12345-0@lo:502:llog_process_th.0 Request processed in 348us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.242996:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783137456.243454:0:8356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8356:1869754990097792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137456.243478:0:8356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137456.243484:0:8356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137456.243486:0:8356:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783137456.243489:0:8356:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1783137456.243659:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1783137456.243677:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783137456.243867:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.243880:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137456.243891:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783137456.243893:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9709886eb800 from 39 10000000:01000000:1.0:1783137456.243901:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783137456.243928:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.243945:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.243963:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137456.243981:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990097920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.244019:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.244050:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.244113:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990097920 00000100:00100000:3.0:1783137456.244119:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990097920 00000100:00100000:3.0:1783137456.244593:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783137456.244603:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+14:5811:x1869754990097920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137456.244615:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137456.244626:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981488e00/0x88def104ac67496d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674966 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.244646:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981488e00/0x88def104ac67496d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674966 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.244656:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981488e00/0x88def104ac67496d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674966 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.244677:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981488e00, rc 0) 00000100:00100000:3.0:1783137456.244729:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990097920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.244735:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783137456.244833:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990097920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137456.244848:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.244856:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137456.244906:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.244931:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.245314:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.245509:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990098048 00000100:00100000:2.0:1783137456.245515:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990098048 00000100:00100000:0.0:1783137456.245561:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783137456.245571:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990098048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.246108:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990098048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 538us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137456.246115:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783137456.246196:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.246231:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.246269:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.246342:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.246344:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990098176 00000100:00100000:2.0:1783137456.246348:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990098176 00000100:00100000:2.0:1783137456.246417:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783137456.246425:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990098176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137456.246569:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990098176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.246575:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783137456.246588:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.247124:0:8357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8357:1869754990098304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137456.247239:0:8357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.247269:0:8357:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137456.247305:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990098304 00000100:00100000:0.0:1783137456.247309:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990098304 00000100:00100000:0.0:1783137456.247510:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783137456.247521:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+15:8357:x1869754990098304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137456.247780:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+15:8357:x1869754990098304:12345-0@lo:502:llog_process_th.0 Request processed in 261us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137456.247787:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783137456.247896:0:8357:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8357:1869754990098304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137456.247946:0:8357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8357:1869754990098432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137456.247989:0:8357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.248019:0:8357:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.248107:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990098432 00000100:00100000:2.0:1783137456.248112:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990098432 00000100:00100000:2.0:1783137456.248716:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783137456.248725:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:8357:x1869754990098432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137456.248993:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:8357:x1869754990098432:12345-0@lo:502:llog_process_th.0 Request processed in 269us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.249000:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783137456.249587:0:8357:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8357:1869754990098432:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783137456.249613:0:8357:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783137456.249742:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783137456.249763:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137456.249772:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.249782:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137456.249807:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783137456.249810:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1783137456.249813:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783137456.249862:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.249871:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.249892:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137456.249910:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.249945:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.249985:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.250046:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990098560 00000100:00100000:2.0:1783137456.250052:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990098560 00000100:00100000:2.0:1783137456.250089:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783137456.250097:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+15:5811:x1869754990098560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137456.250107:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137456.250119:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd050c00/0x88def104ac67497b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674974 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137456.250149:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd050c00/0x88def104ac67497b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674974 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137456.251406:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd050c00/0x88def104ac67497b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674974 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137456.251421:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050c00, rc 0) 00000100:00100000:2.0:1783137456.251482:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990098560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1385us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.251490:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783137456.252004:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137456.252023:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.252032:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137456.252093:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.252125:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.252534:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990098688 00000100:00100000:1.0:1783137456.252540:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990098688 00000100:00100000:1.0:1783137456.252581:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783137456.252590:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990098688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.252988:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25780 going to sleep for 11 seconds 00000100:00100000:0.0:1783137456.253469:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.253505:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.253547:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.253618:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137456.254276:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990098688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1684us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137456.254286:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783137456.254317:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990098816 00000100:00100000:1.0:1783137456.254324:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990098816 00000100:00100000:2.0:1783137456.257076:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783137456.257102:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990098816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137456.257513:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990098816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 423us (3964us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.257523:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783137456.257939:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990098816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137456.259563:0:8358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8358:1869754990098944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137456.259644:0:8358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137456.259692:0:8358:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137456.259925:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990098944 00000100:00100000:1.0:1783137456.259933:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990098944 00000100:00100000:1.0:1783137456.259985:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783137456.259993:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:8358:x1869754990098944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137456.261252:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:8358:x1869754990098944:12345-0@lo:502:llog_process_th.0 Request processed in 1255us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137456.261274:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783137456.265140:0:8358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8358:1869754990098944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137456.265394:0:8358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137456.265407:0:8358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137456.265410:0:8358:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783137456.265415:0:8358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783137456.265464:0:8358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8358:1869754990099072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137456.265525:0:8358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.265611:0:8358:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.267985:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990099072 00000100:00100000:2.0:1783137456.268011:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990099072 00000100:00100000:2.0:1783137456.268110:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783137456.268119:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:8358:x1869754990099072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137456.268390:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:8358:x1869754990099072:12345-0@lo:502:llog_process_th.0 Request processed in 272us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.268398:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783137456.268486:0:8358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8358:1869754990099072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137456.268516:0:8358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137456.268523:0:8358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137456.268526:0:8358:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783137456.268530:0:8358:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1783137456.268868:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1783137456.268887:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783137456.268899:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.268910:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137456.268920:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783137456.268923:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97099cc6e000 from 39 10000000:01000000:1.0:1783137456.268926:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783137456.268967:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.268977:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.268986:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137456.269006:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.269043:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.269919:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214480 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.270013:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990099200 00000100:00100000:3.0:1783137456.270020:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990099200 00000100:00100000:3.0:1783137456.270052:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783137456.270060:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990099200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137456.270071:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137456.270084:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981489000/0x88def104ac674989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674982 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.270106:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981489000/0x88def104ac674989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674982 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.270115:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981489000/0x88def104ac674989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674982 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.270124:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981489000, rc 0) 00000100:00100000:3.0:1783137456.270577:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990099200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 516us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.270583:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783137456.270899:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137456.270914:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.270935:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137456.271002:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.271035:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.271066:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214480 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.271138:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990099328 00000100:00100000:3.0:1783137456.271151:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990099328 00000100:00100000:3.0:1783137456.271186:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783137456.271193:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990099328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137456.271632:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990099328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 429us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.271639:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783137456.271977:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.272020:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.272059:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.272127:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137456.273008:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990099456 00000100:00100000:2.0:1783137456.273015:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990099456 00000100:00100000:2.0:1783137456.273093:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783137456.273101:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990099456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137456.273309:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990099456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.273316:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783137456.273386:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.274103:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8359:1869754990099584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137456.274153:0:8359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.275038:0:8359:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214180 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.277464:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990099584 00000100:00100000:3.0:1783137456.277476:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990099584 00000100:00100000:3.0:1783137456.277527:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783137456.277536:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:8359:x1869754990099584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137456.277977:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:8359:x1869754990099584:12345-0@lo:502:llog_process_th.0 Request processed in 441us (3823us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.277986:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783137456.278331:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8359:1869754990099584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137456.278865:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8359:1869754990099712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137456.278913:0:8359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.279003:0:8359:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214180 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.279041:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990099712 00000100:00100000:3.0:1783137456.279046:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990099712 00000100:00100000:2.0:1783137456.279536:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783137456.279547:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:8359:x1869754990099712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137456.280018:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:8359:x1869754990099712:12345-0@lo:502:llog_process_th.0 Request processed in 472us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.280026:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783137456.280201:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8359:1869754990099712:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783137456.280227:0:8359:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783137456.280301:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783137456.280329:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137456.280341:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.280446:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137456.280521:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783137456.280524:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1783137456.280526:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783137456.280551:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.280615:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.280625:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137456.280644:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.280741:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.280784:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137456.280844:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990099840 00000100:00100000:1.0:1783137456.280851:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990099840 00000100:00100000:1.0:1783137456.280887:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783137456.280901:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990099840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137456.280912:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137456.280923:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0c600/0x88def104ac674997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674990 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.280957:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0c600/0x88def104ac674997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674990 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.280968:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0c600/0x88def104ac674997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674990 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.280976:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c600, rc 0) 00000100:00100000:1.0:1783137456.281016:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990099840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137456.281022:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783137456.281087:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137456.281099:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137456.281107:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137456.281311:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.281340:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.281368:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.281419:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990099968 00000100:00100000:3.0:1783137456.281424:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990099968 00000100:00100000:3.0:1783137456.281512:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783137456.281521:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990099968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137456.281781:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990099968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.281813:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783137456.281888:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990099968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.281917:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990100096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.281962:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.285189:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990100096 00000100:00100000:1.0:1783137456.285204:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990100096 00000100:00100000:0.0:1783137456.285248:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137456.285267:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783137456.285277:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990100096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.285841:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990100096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 564us (3876us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137456.285849:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783137456.285894:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990100096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.286502:0:8360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8360:1869754990100224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137456.286549:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.286610:0:8360:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade250c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137456.286642:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990100224 00000100:00100000:1.0:1783137456.286647:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990100224 00000100:00100000:1.0:1783137456.286894:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783137456.286903:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:8360:x1869754990100224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137456.287156:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:8360:x1869754990100224:12345-0@lo:502:llog_process_th.0 Request processed in 254us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137456.287171:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783137456.287365:0:8360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8360:1869754990100224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137456.287391:0:8360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137456.287400:0:8360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137456.287402:0:8360:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783137456.287407:0:8360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783137456.287427:0:8360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8360:1869754990100352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137456.287466:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137456.287496:0:8360:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade250c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.287542:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990100352 00000100:00100000:3.0:1783137456.287547:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990100352 00000100:00100000:3.0:1783137456.287578:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783137456.287585:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:8360:x1869754990100352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137456.287881:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:8360:x1869754990100352:12345-0@lo:502:llog_process_th.0 Request processed in 160us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.287890:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783137456.287932:0:8360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8360:1869754990100352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783137456.287958:0:8360:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137456.287964:0:8360:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137456.287966:0:8360:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783137456.287971:0:8360:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1783137456.288145:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1783137456.288160:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783137456.288169:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.288180:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137456.288189:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783137456.288192:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9709873db380 from 1 10000000:01000000:1.0:1783137456.288194:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783137456.288215:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.288223:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.288230:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137456.288345:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990100480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.288376:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.288404:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137456.288445:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990100480 00000100:00100000:3.0:1783137456.288449:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990100480 00000100:00100000:3.0:1783137456.288480:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783137456.288487:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990100480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137456.288496:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137456.288506:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981488800/0x88def104ac6749a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67499e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.288525:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981488800/0x88def104ac6749a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67499e expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.288534:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981488800/0x88def104ac6749a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67499e expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137456.288543:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981488800, rc 0) 00000100:00100000:3.0:1783137456.288579:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990100480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137456.288586:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783137456.288668:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990100480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137456.288744:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.289062:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6749a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137456.289107:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990100608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137456.289134:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137456.289226:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137456.289409:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990100608 00000100:00100000:0.0:1783137456.289414:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990100608 00000100:00100000:0.0:1783137456.289471:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783137456.289479:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990100608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137456.289699:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990100608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (564us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783137456.289707:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783137456.289772:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990100608:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783137456.289833:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783137456.289840:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137456.289847:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137456.551925:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137456.551955:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990100736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137456.552023:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137456.552123:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990100736 00000100:00100000:2.0:1783137456.552136:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990100736 00000100:00100000:2.0:1783137456.552194:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783137456.552211:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990100736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783137456.552245:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137456.552304:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990100736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.552311:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1783137456.552489:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd01a300 x1869754990100736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137456.552516:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990100736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137456.614941:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137456.949596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137456.949633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137456.949724:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974343424 00000100:00100000:0.0:1783137456.949739:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974343424 00000100:00100000:0.0:1783137456.949829:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:0.0:1783137456.949840:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:2353:x1869754974343424:12345-192.168.203.36@tcp:400: 00000100:00100000:0.0:1783137456.949896:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:2353:x1869754974343424:12345-192.168.203.36@tcp:400: Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137456.949904:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:1.0:1783137456.950110:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137456.950138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137456.952042:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974343552 00000100:00100000:0.0:1783137456.952054:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974343552 00000100:00100000:0.0:1783137456.952114:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:0.0:1783137456.952122:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974343552:12345-192.168.203.36@tcp:400: 00000100:00100000:0.0:1783137456.952189:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974343552:12345-192.168.203.36@tcp:400: Request processed in 67us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137456.952196:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00080000:3.0:1783137456.952816:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137456.958219:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974343680 00000100:00100000:2.0:1783137456.958233:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974343680 00000100:00100000:2.0:1783137456.958316:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974343808 00000100:00100000:2.0:1783137456.958320:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974343808 00000100:00100000:2.0:1783137456.958349:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:2.0:1783137456.958359:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2353:x1869754974343680:12345-192.168.203.36@tcp:400: 00000100:00100000:2.0:1783137456.958432:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2353:x1869754974343680:12345-192.168.203.36@tcp:400: Request processed in 74us (8797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.958441:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:2.0:1783137456.958460:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:2.0:1783137456.958467:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2353:x1869754974343808:12345-192.168.203.36@tcp:400: 00000100:00100000:2.0:1783137456.958492:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2353:x1869754974343808:12345-192.168.203.36@tcp:400: Request processed in 26us (8353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137456.958498:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00080000:0.0:1783137456.958677:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137456.958682:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137457.065091:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137457.065127:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990100864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137457.065189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137457.065324:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990100864 00000100:00100000:2.0:1783137457.065331:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990100864 00000100:00100000:2.0:1783137457.065376:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783137457.065385:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990100864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137457.065420:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137457.065473:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990100864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137457.065480:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1783137457.065669:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf234700 x1869754990100864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137457.065685:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990100864:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137457.639009:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137458.662967:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137459.687632:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137460.711061:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137461.161693:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990101248:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.161758:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137461.161835:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783137461.161842:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990101120:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.161873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137461.161890:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990101632:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.161911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137461.161954:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990101248 00000100:00100000:2.0:1783137461.161960:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990101248 00000100:00100000:2.0:1783137461.162004:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990101120 00000100:00100000:2.0:1783137461.162006:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990101120 00000100:00100000:2.0:1783137461.162023:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137461.162030:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990101248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162074:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990101248:12345-0@lo:400:kworker.0 Request processed in 44us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137461.162081:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137461.162096:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783137461.162102:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990101120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162124:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990101120:12345-0@lo:400:kworker.0 Request processed in 22us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137461.162129:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783137461.162147:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990101632 00000100:00100000:2.0:1783137461.162150:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990101632 00000100:00100000:2.0:1783137461.162171:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783137461.162177:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990101632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162201:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990101632:12345-0@lo:400:kworker.0 Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137461.162207:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783137461.162228:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990101376:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137461.162616:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783137461.162624:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd01aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990100992:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137461.162686:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990101504:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783137461.162729:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137461.162733:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137461.162741:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990101504 00000100:00100000:2.0:1783137461.162745:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990101504 00000100:00100000:2.0:1783137461.162769:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783137461.162775:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990101504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162832:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990101504:12345-0@lo:400:kworker.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137461.162839:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1783137461.162853:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137461.162875:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990101504:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162904:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990101120:0@lo:400:kworker.0 00010000:00080000:2.0:1783137461.162927:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc9d4700 x1869754990101632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137461.162937:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990101632:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162947:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990101248:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.162984:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990101376 00000100:00100000:2.0:1783137461.162987:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990101376 00000100:00100000:2.0:1783137461.163010:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783137461.163016:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990101376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.163056:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990101376:12345-0@lo:400:kworker.0 Request processed in 40us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137461.163062:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1783137461.163074:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783137461.163088:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc9d4000 x1869754990101376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137461.163097:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990101376:0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.163167:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990100992 00000100:00100000:2.0:1783137461.163171:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990100992 00000100:00100000:2.0:1783137461.163192:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783137461.163198:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990100992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137461.163230:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990100992:12345-0@lo:400:kworker.0 Request processed in 32us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137461.163235:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783137461.163268:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd01aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990100992:0@lo:400:kworker.0 00000100:00100000:0.0:1783137461.671085:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990101760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137461.671151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137461.671338:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990101760 00000100:00100000:2.0:1783137461.671346:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990101760 00000100:00100000:2.0:1783137461.671462:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783137461.671471:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990101760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783137461.671504:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137461.671632:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990101760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137461.671641:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783137461.673996:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc9d4000 x1869754990101760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137461.674022:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990101760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137461.735096:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137462.069405:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137462.069554:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974343936 00000100:00100000:3.0:1783137462.069565:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974343936 00000100:00100000:3.0:1783137462.069620:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:3.0:1783137462.069632:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:5571:x1869754974343936:12345-192.168.203.36@tcp:101: 00010000:00010000:3.0:1783137462.069648:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137462.069665:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981488600/0x88def104ac6749ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec726ef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137462.069707:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981488600/0x88def104ac6749ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726ef expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137462.069719:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981488600/0x88def104ac6749ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726ef expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137462.069728:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981488600, rc 0) 00000100:00100000:3.0:1783137462.070631:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5571:x1869754974343936:12345-192.168.203.36@tcp:101: Request processed in 997us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137462.070639:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:1.0:1783137462.078286:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137462.078562:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974344064 00000100:00100000:2.0:1783137462.078571:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974344064 00000100:00080000:3.0:1783137462.078674:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137462.079313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137462.079369:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974344320 00000100:00100000:3.0:1783137462.079375:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974344320 00000100:00100000:3.0:1783137462.079434:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1783137462.079444:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974344320:12345-192.168.203.36@tcp:400: 00000100:00100000:2.0:1783137462.079456:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1783137462.079468:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974344064:12345-192.168.203.36@tcp:400: 00000100:00080000:0.0:1783137462.079543:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137462.079567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137462.079613:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974344064:12345-192.168.203.36@tcp:400: Request processed in 147us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137462.079621:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1783137462.079868:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974344192 00000100:00100000:2.0:1783137462.079873:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974344192 00000100:00100000:2.0:1783137462.079904:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:2.0:1783137462.079922:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974344192:12345-192.168.203.36@tcp:400: 00000100:00100000:3.0:1783137462.080054:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974344320:12345-192.168.203.36@tcp:400: Request processed in 610us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137462.080065:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00080000:3.0:1783137462.080182:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137462.084731:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974344192:12345-192.168.203.36@tcp:400: Request processed in 4800us (5144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137462.084745:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:0.0:1783137462.086515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137462.086601:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974344448 00000100:00100000:2.0:1783137462.086610:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974344448 00000100:00100000:2.0:1783137462.086788:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 168 00000100:00100000:2.0:1783137462.086821:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5571:x1869754974344448:12345-192.168.203.36@tcp:501: 00000100:00100000:2.0:1783137462.087332:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5571:x1869754974344448:12345-192.168.203.36@tcp:501: Request processed in 512us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137462.087340:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 168 00000100:00100000:1.0:1783137462.090603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137462.090687:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974344576 00000100:00100000:3.0:1783137462.090696:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974344576 00000100:00100000:3.0:1783137462.090746:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 169 00000100:00100000:3.0:1783137462.090755:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5571:x1869754974344576:12345-192.168.203.36@tcp:503: 00000100:00100000:3.0:1783137462.091595:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5571:x1869754974344576:12345-192.168.203.36@tcp:503: Request processed in 838us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137462.091606:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 169 00000100:00100000:1.0:1783137462.097568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137462.102560:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974344704 00000100:00100000:2.0:1783137462.102576:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974344704 00000100:00100000:2.0:1783137462.102768:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 170 00000100:00100000:2.0:1783137462.102781:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:6072:x1869754974344704:12345-192.168.203.36@tcp:502: 00000100:00100000:2.0:1783137462.103080:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:6072:x1869754974344704:12345-192.168.203.36@tcp:502: Request processed in 301us (5521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137462.105897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137462.106002:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974344832 00000100:00100000:1.0:1783137462.106011:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974344832 00000100:00100000:2.0:1783137462.106435:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 170 00000100:00100000:1.0:1783137462.106584:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:1.0:1783137462.106594:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:6072:x1869754974344832:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783137462.106886:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:6072:x1869754974344832:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 293us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137462.106894:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:2.0:1783137462.109992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137462.112083:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974344960 00000100:00100000:0.0:1783137462.112095:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974344960 00000100:00100000:0.0:1783137462.112300:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:0.0:1783137462.112311:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5571:x1869754974344960:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137462.112327:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137462.112343:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980030000/0x88def104ac6749b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec726f6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137462.112369:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980030000/0x88def104ac6749b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726f6 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137462.112379:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980030000/0x88def104ac6749b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726f6 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137462.112387:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980030000, rc 0) 00000100:00100000:0.0:1783137462.112449:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5571:x1869754974344960:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 140us (2465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137462.112469:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:2.0:1783137462.116175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137462.116312:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974345088 00000100:00100000:0.0:1783137462.116320:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974345088 00000100:00100000:0.0:1783137462.116371:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 173 00000100:00100000:0.0:1783137462.116381:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5571:x1869754974345088:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137462.116762:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5571:x1869754974345088:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 382us (594us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783137462.116771:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 173 00000100:00100000:1.0:1783137462.184552:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137462.184578:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990101888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137462.184644:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137462.184943:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990101888 00000100:00100000:3.0:1783137462.184951:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990101888 00000100:00100000:3.0:1783137462.185046:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137462.185056:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990101888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137462.185091:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137462.185149:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990101888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137462.185156:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1783137462.185222:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf236a00 x1869754990101888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137462.185239:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990101888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137462.759488:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783137463.612592:0:8401:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7893d860 20000000:00000080:3.0:1783137463.612610:0:8401:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9709b7e9b800 uarg=0000000000000000 20000000:01000000:3.0:1783137463.612713:0:8401:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783137463.612720:0:8401:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783137463.612725:0:8401:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783137463.614146:0:8402:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1783137463.614370:0:8401:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1783137463.620496:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1783137463.620555:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1783137463.620612:0:8401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1783137463.620643:0:8401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783137463.620665:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.620689:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970981488000/0x88def104ac674783 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67477c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.620697:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6747fa expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.620703:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674855 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.620712:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726be expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.620720:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.620758:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726be expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.620771:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726be expref: 9 pid: 5809 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137463.620784:0:8401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8401:1869754990102016:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137463.621206:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac674855 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621216:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac674855 expref: 18 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137463.621226:0:8401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8401:1869754990102144:0@lo:104: 00000100:00100000:3.0:1783137463.621273:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783137463.621307:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6747fa expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621315:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6747fa expref: 18 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137463.621323:0:8401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8401:1869754990102272:0@lo:104: 00000100:00100000:3.0:1783137463.621347:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137463.621375:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783137463.621386:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990102144 00000100:00100000:3.0:1783137463.621391:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990102144 00000100:00100000:3.0:1783137463.621419:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990102272 00000100:00100000:3.0:1783137463.621421:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990102272 00000100:00100000:3.0:1783137463.621436:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783137463.621443:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:8401:x1869754990102144:12345-0@lo:104: 00010000:00010000:3.0:1783137463.621455:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621496:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137463.621501:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:8401:x1869754990102144:12345-0@lo:104: Request processed in 59us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137463.621508:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783137463.621525:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783137463.621531:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bcb2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:8401:x1869754990102272:12345-0@lo:104: 00010000:00010000:3.0:1783137463.621538:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621568:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783137463.621580:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bcb2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:8401:x1869754990102272:12345-0@lo:104: Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137463.621586:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1783137463.621620:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783137463.621625:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621644:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2173000 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137463.621648:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621656:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137463.621663:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137463.621668:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783137463.621694:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621701:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137463.621719:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621726:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2173000/0x88def104ac674855 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac67485c expref: -99 pid: 7517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621745:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137463.621749:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621765:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2173400 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137463.621768:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621775:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137463.621780:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137463.621785:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783137463.621818:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621824:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137463.621839:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621845:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2173400/0x88def104ac6747fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674801 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.621856:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137463.621858:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137463.621859:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137463.622146:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137463.622153:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137463.622166:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990102528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137463.622200:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137463.622238:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990102528 00000100:00100000:0.0:1783137463.622243:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990102528 00010000:00010000:0.0:1783137463.622261:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6747fa expref: 19 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137463.622282:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783137463.622289:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990102528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783137463.622299:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137463.622304:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6747fa expref: 19 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.622526:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970981488000/0x88def104ac674783 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac67477c expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.622537:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff970981488000/0x88def104ac674783 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac67477c expref: 19 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137463.622560:0:8401:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8401:1869754990102656:0@lo:104: 00000100:00100000:3.0:1783137463.622585:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137463.622608:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990102656 00000100:00100000:3.0:1783137463.622612:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990102656 00000100:00100000:3.0:1783137463.622643:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783137463.622649:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:8401:x1869754990102656:12345-0@lo:104: 00010000:00010000:3.0:1783137463.622658:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.622693:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137463.622698:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:8401:x1869754990102656:12345-0@lo:104: Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137463.622704:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1783137463.622719:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137463.622724:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.622746:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031200 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137463.622750:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.622758:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137463.622764:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137463.622770:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783137463.622808:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.622815:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137463.622828:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.622836:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970980031200/0x88def104ac67477c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674783 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.622851:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137463.622853:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137463.622854:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137463.622944:0:8401:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ce7dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137463.622965:0:8401:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8401:1869754990102144:0@lo:104: 00000100:00100000:3.0:1783137463.622973:0:8401:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8401:1869754990102272:0@lo:104: 00000100:00100000:3.0:1783137463.622980:0:8401:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8401:1869754990102656:0@lo:104: 00000100:00100000:2.0:1783137463.623163:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137463.623175:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990102400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137463.623590:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137463.623610:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990102784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137463.623651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137463.623762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137463.623852:0:5799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783137463.623861:0:5799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1783137463.624082:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6747fa expref: 19 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.624111:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981489800/0x88def104ac674801 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6747fa expref: 19 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.624125:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137463.624160:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+18:3309:x1869754990102528:12345-0@lo:103:ldlm_bl.0 Request processed in 1872us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137463.624168:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783137463.624186:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990102784 00000100:00100000:0.0:1783137463.624191:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990102784 00010000:00010000:0.0:1783137463.624220:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970981488000/0x88def104ac674783 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67477c expref: 18 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137463.624234:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990102400 00000100:00100000:0.0:1783137463.624237:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990102400 00010000:00010000:0.0:1783137463.624249:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674855 expref: 19 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137463.624262:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137463.624268:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990102784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783137463.624279:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137463.624284:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970981488000/0x88def104ac674783 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac67477c expref: 19 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.624291:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970981488000/0x88def104ac674783 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac67477c expref: 19 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.624301:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488000/0x88def104ac674783 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac67477c expref: 19 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.624321:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137463.624351:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+18:3308:x1869754990102784:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137463.624357:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137463.624370:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783137463.624375:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+17:3306:x1869754990102400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783137463.624383:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137463.624387:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674855 expref: 17 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.624395:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac674855 expref: 17 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.624404:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970980030a00/0x88def104ac67485c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac674855 expref: 17 pid: 5809 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.624414:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137463.624439:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+16:3306:x1869754990102400:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137463.624444:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783137463.624473:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990102528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137463.624651:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990102784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137463.624673:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990102400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137463.631657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137463.632320:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974345216 00000100:00100000:0.0:1783137463.632329:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974345216 00010000:00010000:0.0:1783137463.632367:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726be expref: 10 pid: 5809 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137463.632397:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:0.0:1783137463.632420:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2351:x1869754974345216:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137463.632434:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137463.632440:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726be expref: 10 pid: 5809 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632453:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726be expref: 10 pid: 5809 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632473:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632482:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632499:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632507:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632514:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632521:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632527:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970981488c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137463.632531:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632538:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632555:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.632565:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137463.632622:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2351:x1869754974345216:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 203us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137463.632984:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00010000:00010000:3.0:1783137463.635045:0:8401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709afd0d000/0x88def104ac674919 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726be expref: 9 pid: 5809 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137463.635065:0:8401:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8401:1869754990102016:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137463.635097:0:8401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.635192:0:8401:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.635208:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137463.635232:0:8401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488c00/0x88def104ac6749ba lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137463.783704:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137464.042327:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137464.042864:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974345344 00000100:00100000:3.0:1783137464.042874:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974345344 00000100:00100000:3.0:1783137464.042927:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 174 00000100:00100000:3.0:1783137464.042936:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:5571:x1869754974345344:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137464.042952:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137464.042970:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec726fd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137464.042997:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726fd expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137464.043008:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726fd expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137464.043017:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981488c00, rc 0) 00000100:00100000:3.0:1783137464.043066:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5571:x1869754974345344:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 131us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137464.043074:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 174 00000100:00100000:0.0:1783137464.054778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137464.059719:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974345472 00000100:00100000:1.0:1783137464.059732:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974345472 00000100:00100000:1.0:1783137464.059910:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 175 00000100:00100000:1.0:1783137464.059921:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5571:x1869754974345472:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137464.061499:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5571:x1869754974345472:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 1572us (6721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137464.061512:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 175 00000100:00100000:3.0:1783137464.067237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137464.067567:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974345600 00000100:00100000:2.0:1783137464.067578:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974345600 00000100:00100000:2.0:1783137464.067627:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:2.0:1783137464.067723:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5571:x1869754974345600:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137464.067954:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:5571:x1869754974345600:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 232us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137464.073140:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137464.073178:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974345728 00000100:00100000:3.0:1783137464.073187:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974345728 00000100:00100000:3.0:1783137464.073455:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:3.0:1783137464.073465:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:6130:x1869754974345728:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783137464.073684:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:6130:x1869754974345728:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 220us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137464.073691:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:2.0:1783137464.073907:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:0.0:1783137464.077299:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137464.077409:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974345856 00000100:00100000:3.0:1783137464.077418:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974345856 00000100:00100000:3.0:1783137464.077468:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 178 00000100:00100000:3.0:1783137464.077476:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:6130:x1869754974345856:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783137464.077701:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:6130:x1869754974345856:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 224us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137464.077709:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 178 00010000:00010000:3.0:1783137464.807235:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783137464.999128:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783137464.999242:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709b7c81800 from 4 10000000:01000000:2.0:1783137464.999247:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783137464.999289:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137464.999301:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137464.999312:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137464.999350:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990102912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783137464.999415:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137465.000251:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709b784f600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137465.002706:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990102912 00000100:00100000:0.0:1783137465.002721:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990102912 00000100:00100000:0.0:1783137465.002841:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783137465.002852:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990102912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137465.002867:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137465.002884:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6749c8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137465.002920:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6749c8 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137465.002931:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6749c8 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137465.002939:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980030a00, rc 0) 00000100:00100000:0.0:1783137465.003007:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990102912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (3592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137465.003026:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783137465.003123:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990102912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137465.003150:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137465.003160:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137465.003223:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137465.003255:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.006706:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69a540 going to sleep for 11 seconds 00000100:00100000:2.0:1783137465.008587:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990103040 00000100:00100000:2.0:1783137465.008600:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990103040 00000100:00100000:2.0:1783137465.008689:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783137465.008700:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990103040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137465.009455:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990103040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 754us (6196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137465.009463:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783137465.010642:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137465.010691:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137465.010747:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.010811:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69a540 going to sleep for 11 seconds 00000100:00100000:0.0:1783137465.010863:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990103168 00000100:00100000:0.0:1783137465.010870:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990103168 00000100:00100000:0.0:1783137465.010918:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783137465.010928:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990103168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137465.011084:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990103168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137465.011093:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783137465.011103:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137465.022755:0:8471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8471:1869754990103296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137465.022977:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.023054:0:8471:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69a540 going to sleep for 11 seconds 00000100:00100000:0.0:1783137465.023094:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990103296 00000100:00100000:0.0:1783137465.023101:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990103296 00000100:00100000:0.0:1783137465.023296:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783137465.023306:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:8471:x1869754990103296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137465.023531:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:8471:x1869754990103296:12345-0@lo:502:llog_process_th.0 Request processed in 226us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137465.023539:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783137465.023619:0:8471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8471:1869754990103296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783137465.023660:0:8471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137465.023667:0:8471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137465.023670:0:8471:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783137465.023678:0:8471:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9709b7c81800 00000020:00000080:2.0:1783137465.023680:0:8471:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783137465.023761:0:8471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8471:1869754990103424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137465.023818:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137465.026543:0:8471:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709b784f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137465.026576:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990103424 00000100:00100000:1.0:1783137465.026584:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990103424 00000100:00100000:0.0:1783137465.026700:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783137465.026711:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:8471:x1869754990103424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137465.026972:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:8471:x1869754990103424:12345-0@lo:502:llog_process_th.0 Request processed in 262us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137465.026980:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783137465.027072:0:8471:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8471:1869754990103424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783137465.027112:0:8471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137465.027119:0:8471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137465.027121:0:8471:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783137465.027128:0:8471:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783137465.027565:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783137465.027581:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137465.027592:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137465.027603:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137465.027613:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783137465.027615:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709886eb800 from 4 10000000:01000000:1.0:1783137465.027617:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137465.027710:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137465.027719:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137465.027727:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137465.027746:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137465.027781:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.027832:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137465.027905:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990103552 00000100:00100000:2.0:1783137465.027917:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990103552 00000100:00100000:2.0:1783137465.027937:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783137465.027942:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990103552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137465.027951:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137465.027963:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6749d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137465.027983:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6749d6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137465.027993:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6749d6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137465.028001:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051000, rc 0) 00000100:00100000:2.0:1783137465.028030:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990103552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137465.028036:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783137465.029597:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137465.029616:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137465.029699:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137465.029760:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137465.029832:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.029863:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137465.029935:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990103680 00000100:00100000:2.0:1783137465.029941:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990103680 00000100:00100000:2.0:1783137465.029979:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783137465.029986:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990103680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137465.030344:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990103680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137465.030352:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783137465.030585:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137465.030615:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137465.030916:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.030949:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137465.030994:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990103808 00000100:00100000:2.0:1783137465.030999:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990103808 00000100:00100000:2.0:1783137465.031028:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783137465.031034:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990103808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137465.031290:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990103808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137465.031297:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783137465.031375:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990103808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137465.034322:0:8473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8473:1869754990103936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137465.034758:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.034825:0:8473:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bf214780 going to sleep for 11 seconds 00000100:00100000:3.0:1783137465.034922:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990103936 00000100:00100000:3.0:1783137465.034930:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990103936 00000100:00100000:3.0:1783137465.034978:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783137465.034987:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:8473:x1869754990103936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137465.036404:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:8473:x1869754990103936:12345-0@lo:502:llog_process_th.0 Request processed in 1412us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137465.036416:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783137465.040601:0:8473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8473:1869754990103936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137465.040874:0:8473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137465.040884:0:8473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137465.040886:0:8473:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783137465.040903:0:8473:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9709886eb800 00000020:00000080:1.0:1783137465.040905:0:8473:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783137465.041238:0:8473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8473:1869754990104064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137465.041303:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.041350:0:8473:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137465.041412:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990104064 00000100:00100000:2.0:1783137465.041419:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990104064 00000100:00100000:2.0:1783137465.041466:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1783137465.041484:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+18:8473:x1869754990104064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137465.041700:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+18:8473:x1869754990104064:12345-0@lo:502:llog_process_th.0 Request processed in 225us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137465.041708:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783137465.042301:0:8473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8473:1869754990104064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137465.042325:0:8473:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137465.042335:0:8473:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137465.042337:0:8473:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783137465.042341:0:8473:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783137465.042968:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783137465.042988:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783137465.042999:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137465.043011:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137465.043021:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783137465.043024:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97099cc6e000 from 4 10000000:01000000:2.0:1783137465.043026:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783137465.043051:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137465.043058:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137465.043151:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137465.043237:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990104192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783137465.043280:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137465.043313:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709b784f300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137465.043354:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990104192 00000100:00100000:3.0:1783137465.043360:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990104192 00000100:00100000:3.0:1783137465.043424:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783137465.043433:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990104192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137465.043443:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137465.043455:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac6749e4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137465.043560:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac6749e4 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137465.043574:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6749e4 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137465.043582:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970981488000, rc 0) 00000100:00100000:3.0:1783137465.043656:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990104192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137465.043663:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783137465.043952:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990104192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137465.043965:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137465.043974:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137465.044020:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990104320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137465.044046:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137465.044144:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990104320 00000100:00100000:0.0:1783137465.044149:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990104320 00000100:00100000:0.0:1783137465.044183:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783137465.044190:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990104320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137465.044269:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709b784f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783137465.044426:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990104320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137465.044434:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1783137465.044564:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990104320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137465.044596:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990104448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137465.044633:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137465.044653:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709b784f300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137465.044698:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990104448 00000100:00100000:3.0:1783137465.044702:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990104448 00000100:00100000:3.0:1783137465.044730:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1783137465.044737:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990104448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137465.044938:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990104448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137465.044945:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1783137465.044988:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990104448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137465.045543:0:8475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8475:1869754990104576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137465.045581:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.045700:0:8475:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69a600 going to sleep for 11 seconds 00000100:00100000:3.0:1783137465.045731:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990104576 00000100:00100000:3.0:1783137465.045735:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990104576 00000100:00100000:3.0:1783137465.045822:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1783137465.045830:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:8475:x1869754990104576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137465.045980:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:8475:x1869754990104576:12345-0@lo:502:llog_process_th.0 Request processed in 150us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137465.045987:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1783137465.046060:0:8475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8475:1869754990104576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137465.046082:0:8475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137465.046090:0:8475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137465.046092:0:8475:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783137465.046098:0:8475:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97099cc6e000 00000020:00000080:1.0:1783137465.046101:0:8475:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783137465.046184:0:8475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8475:1869754990104704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137465.046215:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137465.046642:0:8475:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b69a600 going to sleep for 11 seconds 00000100:00100000:0.0:1783137465.046717:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990104704 00000100:00100000:0.0:1783137465.046722:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990104704 00000100:00100000:0.0:1783137465.046745:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783137465.046752:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:8475:x1869754990104704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137465.047826:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:8475:x1869754990104704:12345-0@lo:502:llog_process_th.0 Request processed in 1070us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137465.047836:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783137465.047985:0:8475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:8475:1869754990104704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137465.048008:0:8475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137465.048014:0:8475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137465.048016:0:8475:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783137465.048019:0:8475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783137465.048284:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783137465.048304:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783137465.048314:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137465.048331:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137465.831109:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137466.283461:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990104960:0@lo:400:kworker.0 00000100:00100000:3.0:1783137466.283520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137466.283564:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990105472:0@lo:400:kworker.0 00000100:00100000:3.0:1783137466.283584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137466.283608:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783137466.283613:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990104832:0@lo:400:kworker.0 00000100:00100000:3.0:1783137466.283634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137466.283649:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990105344:0@lo:400:kworker.0 00000100:00100000:3.0:1783137466.283663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137466.283685:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990104960 00000100:00100000:3.0:1783137466.283691:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990104960 00000100:00100000:3.0:1783137466.283724:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990105344 00000100:00100000:3.0:1783137466.283727:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990105344 00000100:00100000:3.0:1783137466.283753:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783137466.283760:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990104960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137466.283816:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990104960:12345-0@lo:400:kworker.0 Request processed in 56us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137466.283823:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783137466.283836:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783137466.283842:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990105344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137466.283875:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990105344:12345-0@lo:400:kworker.0 Request processed in 33us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137466.284057:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990105216:0@lo:400:kworker.0 00000100:00100000:0.0:1783137466.284085:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137466.284104:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137466.284109:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990105088:0@lo:400:kworker.0 00000100:00100000:0.0:1783137466.284125:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137466.284155:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990105088 00000100:00100000:0.0:1783137466.284158:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990105088 00000100:00100000:0.0:1783137466.284176:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783137466.284181:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990105088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137466.284208:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990105088:12345-0@lo:400:kworker.0 Request processed in 28us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137466.284214:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1783137466.284229:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137466.284253:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990104832 00000100:00100000:0.0:1783137466.284256:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990104832 00000100:00100000:0.0:1783137466.284276:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783137466.284281:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990104832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137466.284318:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990104832:12345-0@lo:400:kworker.0 Request processed in 37us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137466.284324:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783137466.284345:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990105472 00000100:00100000:0.0:1783137466.284348:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990105472 00000100:00100000:0.0:1783137466.284369:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990105216 00000100:00100000:0.0:1783137466.284371:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990105216 00000100:00100000:0.0:1783137466.284386:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137466.284391:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990105472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137466.284415:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990105472:12345-0@lo:400:kworker.0 Request processed in 23us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137466.284420:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783137466.284428:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783137466.284433:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990105216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137466.284450:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990105216:12345-0@lo:400:kworker.0 Request processed in 18us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137466.284455:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1783137466.284467:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137466.284470:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137466.284489:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990105088:0@lo:400:kworker.0 00010000:00080000:0.0:1783137466.284500:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf235f80 x1869754990105216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137466.284509:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990105216:0@lo:400:kworker.0 00000100:00100000:0.0:1783137466.285047:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990104832:0@lo:400:kworker.0 00000100:00100000:0.0:1783137466.285058:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990105344:0@lo:400:kworker.0 00000100:00100000:0.0:1783137466.285067:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990104960:0@lo:400:kworker.0 00010000:00080000:0.0:1783137466.285075:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf235c00 x1869754990105472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137466.285084:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990105472:0@lo:400:kworker.0 00000100:00100000:3.0:1783137466.285525:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783137466.793928:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990105600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137466.793995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137466.794072:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990105600 00000100:00100000:2.0:1783137466.794547:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990105600 00000100:00100000:2.0:1783137466.794675:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783137466.794686:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990105600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783137466.794724:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137466.795731:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990105600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1044us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137466.796358:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1783137466.796513:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc9d5880 x1869754990105600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137466.796535:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990105600:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137466.860394:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137467.189974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137467.190018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137467.190049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137467.190096:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137467.190138:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974345984 00000100:00100000:0.0:1783137467.190160:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974345984 00000100:00100000:0.0:1783137467.190222:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:0.0:1783137467.190233:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2352:x1869754974345984:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137467.190297:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2352:x1869754974345984:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 66us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137467.190304:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:0.0:1783137467.190346:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974346368 00000100:00100000:0.0:1783137467.190350:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974346368 00000100:00100000:0.0:1783137467.190379:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974346240 00000100:00100000:0.0:1783137467.190382:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974346240 00000100:00100000:0.0:1783137467.190403:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1783137467.190409:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974346368:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137467.190437:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974346368:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137467.190455:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1783137467.190468:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:0.0:1783137467.190474:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974346240:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137467.190500:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974346240:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137467.190506:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00080000:0.0:1783137467.190623:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137467.190628:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783137467.190710:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974346112 00000100:00100000:2.0:1783137467.190715:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974346112 00000100:00100000:2.0:1783137467.190755:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:2.0:1783137467.190763:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974346112:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137467.190818:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974346112:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 56us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137467.190826:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00080000:0.0:1783137467.191036:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137467.303038:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990105728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137467.303106:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137467.303189:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990105728 00000100:00100000:1.0:1783137467.303197:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990105728 00000100:00100000:1.0:1783137467.303251:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783137467.303261:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990105728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137467.303304:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137467.303358:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990105728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137467.303373:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1783137467.303471:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf235c00 x1869754990105728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137467.303488:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990105728:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137467.883507:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137468.904062:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783137469.722387:0:8701:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1783137469.926881:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137470.951129:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137471.399003:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990106112:0@lo:400:kworker.0 00000100:00100000:3.0:1783137471.399067:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137471.399116:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137471.399123:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990106240:0@lo:400:kworker.0 00000100:00100000:3.0:1783137471.399148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137471.399250:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990105856:0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137471.399308:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990106368:0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137471.399360:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783137471.399367:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990105984:0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137471.399403:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990106496:0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137471.399448:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990106112 00000100:00100000:0.0:1783137471.399454:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990106112 00000100:00100000:0.0:1783137471.399494:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990106368 00000100:00100000:0.0:1783137471.399497:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990106368 00000100:00100000:0.0:1783137471.399508:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990105984 00000100:00100000:0.0:1783137471.399510:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990105984 00000100:00100000:0.0:1783137471.399531:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783137471.399538:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990106112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399597:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990106112:12345-0@lo:400:kworker.0 Request processed in 60us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137471.399604:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783137471.399618:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783137471.399623:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990106368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399648:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990106368:12345-0@lo:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137471.399652:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783137471.399661:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783137471.399666:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990105984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399688:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990105984:12345-0@lo:400:kworker.0 Request processed in 22us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137471.399693:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783137471.399710:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990106240 00000100:00100000:0.0:1783137471.399713:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990106240 00000100:00100000:0.0:1783137471.399732:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990106496 00000100:00100000:0.0:1783137471.399734:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990106496 00000100:00100000:0.0:1783137471.399750:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137471.399755:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990106240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399780:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990106240:12345-0@lo:400:kworker.0 Request processed in 25us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137471.399785:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137471.399819:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783137471.399826:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990106496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399875:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990106496:12345-0@lo:400:kworker.0 Request processed in 50us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137471.399882:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783137471.399919:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990105856 00000100:00100000:0.0:1783137471.399923:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990105856 00000100:00100000:0.0:1783137471.399946:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1783137471.399952:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990105856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.399981:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990105856:12345-0@lo:400:kworker.0 Request processed in 29us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137471.399986:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:0.0:1783137471.400014:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137471.400018:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137471.400019:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783137471.400388:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf237480 x1869754990106240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137471.400402:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990106240:0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.400414:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990106112:0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.400446:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990105984:0@lo:400:kworker.0 00010000:00080000:0.0:1783137471.400457:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf235500 x1869754990106496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137471.400466:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990106496:0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.400474:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990105856:0@lo:400:kworker.0 00000100:00100000:0.0:1783137471.400483:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990106368:0@lo:400:kworker.0 00000100:00100000:1.0:1783137471.911832:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137471.911864:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990106624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137471.911940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137471.912139:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990106624 00000100:00100000:3.0:1783137471.912148:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990106624 00000100:00100000:3.0:1783137471.912216:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783137471.912224:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990106624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137471.912257:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137471.912314:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990106624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137471.912321:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1783137471.912389:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd917b80 x1869754990106624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137471.912407:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990106624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137471.974915:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137472.311760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137472.317884:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974346496 00000100:00100000:3.0:1783137472.317899:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974346496 00000100:00100000:3.0:1783137472.317956:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:3.0:1783137472.317965:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2351:x1869754974346496:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137472.320562:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2351:x1869754974346496:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 2587us (8800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137472.320671:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:1.0:1783137472.320984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137472.321109:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137472.321133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137472.321157:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974346752 00000100:00100000:1.0:1783137472.321164:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974346752 00000100:00100000:1.0:1783137472.321207:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974346880 00000100:00100000:1.0:1783137472.321210:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974346880 00000100:00100000:1.0:1783137472.321231:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1783137472.321240:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2350:x1869754974346752:12345-192.168.203.36@tcp:9:kworker.0 00000020:00000080:1.0:1783137472.321270:0:6620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674927 00000100:00080000:1.0:1783137472.321280:0:6620:0:(import.c:65:import_set_state_nolock()) ffff9709b7c71800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783137472.321312:0:6620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783137472.321716:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+2:2350:x1869754974346752:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 476us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137472.321724:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1783137472.321739:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:1.0:1783137472.321748:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2350:x1869754974346880:12345-192.168.203.36@tcp:9:kworker.0 00000020:00000080:1.0:1783137472.321771:0:6620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac67492e 00000100:00080000:1.0:1783137472.321779:0:6620:0:(import.c:65:import_set_state_nolock()) ffff9709b7c74800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783137472.321822:0:6620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783137472.322023:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+2:2350:x1869754974346880:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 276us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137472.322030:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00080000:1.0:1783137472.322051:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137472.322055:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783137472.322116:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137472.322184:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137472.322538:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974346624 00000100:00100000:2.0:1783137472.322545:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974346624 00000100:00100000:2.0:1783137472.322744:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:2.0:1783137472.322753:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974346624:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137472.322819:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974346624:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 67us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137472.322827:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00080000:1.0:1783137472.323064:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137472.426499:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137472.426520:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990106752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137472.426696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137472.426770:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990106752 00000100:00100000:0.0:1783137472.426777:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990106752 00000100:00100000:0.0:1783137472.426833:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783137472.426852:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990106752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137472.426885:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137472.426931:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990106752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137472.426937:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1783137472.426977:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a80000 x1869754990106752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137472.426995:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990106752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783137472.999244:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137473.992140:0:8945:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing yml_node 00010000:00010000:3.0:1783137474.026904:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137475.047383:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783137475.066916:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:2.0:1783137475.066932:0:6644:0:(genops.c:906:class_export_put()) final put ffff9709b7c75000/d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:3.0:1783137475.067016:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c75000/d717cef4-1367-4dd9-ae68-a0c1ee666834 for lustre-OST0000 00000020:00000080:3.0:1783137475.067065:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7c71800 for lustre-OST0000 00010000:00010000:3.0:1783137476.071846:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137476.520408:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990107136:0@lo:400:kworker.0 00000100:00100000:0.0:1783137476.520471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137476.520540:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137476.520547:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990107264:0@lo:400:kworker.0 00000100:00100000:0.0:1783137476.520580:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137476.520611:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990107136 00000100:00100000:0.0:1783137476.520618:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990107136 00000100:00100000:0.0:1783137476.520661:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137476.520669:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990107136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137476.520716:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990107136:12345-0@lo:400:kworker.0 Request processed in 47us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137476.520742:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137476.520781:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990107136:0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.521488:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990106880:0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.521529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137476.521570:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990107392:0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.521596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137476.521617:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783137476.521625:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990107008:0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.521647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137476.521668:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990107520:0@lo:400:kworker.0 00000100:00100000:3.0:1783137476.521685:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990107392 00000100:00100000:1.0:1783137476.521691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137476.521693:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990107392 00000100:00100000:3.0:1783137476.521733:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990107008 00000100:00100000:3.0:1783137476.521736:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990107008 00000100:00100000:1.0:1783137476.521742:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990107264 00000100:00100000:1.0:1783137476.521748:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990107264 00000100:00100000:3.0:1783137476.521755:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783137476.521765:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990107392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.521781:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990107520 00000100:00100000:1.0:1783137476.521785:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990107520 00000100:00100000:1.0:1783137476.521841:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783137476.521858:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990107264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137476.521861:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990107392:12345-0@lo:400:kworker.0 Request processed in 97us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137476.521871:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783137476.521888:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783137476.521896:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990107008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.521905:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990107264:12345-0@lo:400:kworker.0 Request processed in 49us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137476.521912:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783137476.521929:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783137476.521936:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990107008:12345-0@lo:400:kworker.0 Request processed in 40us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137476.521938:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990107520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137476.521950:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783137476.521978:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990107520:12345-0@lo:400:kworker.0 Request processed in 42us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137476.521986:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1783137476.522007:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137476.522011:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137476.522015:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137476.522050:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990107008:0@lo:400:kworker.0 00010000:00080000:1.0:1783137476.522066:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a81f80 x1869754990107520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137476.522077:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990107520:0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.522091:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990107392:0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.522226:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990106880 00000100:00100000:1.0:1783137476.522230:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990106880 00000100:00100000:1.0:1783137476.522255:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1783137476.522261:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990106880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.522295:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990106880:12345-0@lo:400:kworker.0 Request processed in 34us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137476.522301:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:3.0:1783137476.522625:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a80e00 x1869754990107264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137476.522637:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990107264:0@lo:400:kworker.0 00000100:00100000:1.0:1783137476.525911:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990106880:0@lo:400:kworker.0 00000001:00100000:3.0:1783137476.634472:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:3.0:1783137476.634482:0:7535:0:(genops.c:906:class_export_put()) final put ffff9709b7c70000/d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:1.0:1783137476.634969:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c70000/d717cef4-1367-4dd9-ae68-a0c1ee666834 for lustre-OST0001 00000020:00000080:1.0:1783137476.635021:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7c74800 for lustre-OST0001 00000100:00100000:2.0:1783137477.031583:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783137477.031606:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990107648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137477.031682:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137477.031860:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990107648 00000100:00100000:0.0:1783137477.031867:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990107648 00000100:00100000:0.0:1783137477.031924:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783137477.031933:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990107648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137477.031968:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137477.032025:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990107648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137477.032032:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783137477.032079:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b7ca8e00 x1869754990107648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137477.032099:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990107648:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137477.095572:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137477.440725:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137477.440771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137477.440907:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974347136 00000100:00100000:2.0:1783137477.440916:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974347136 00000100:00100000:2.0:1783137477.440995:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:2.0:1783137477.441006:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974347136:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137477.441074:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974347136:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137477.441081:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00080000:1.0:1783137477.441274:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137477.441372:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974347008 00000100:00100000:3.0:1783137477.441376:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974347008 00000100:00100000:3.0:1783137477.441539:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:3.0:1783137477.441545:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2353:x1869754974347008:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137477.441590:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2353:x1869754974347008:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 46us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137477.441595:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:2.0:1783137477.543210:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990107776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137477.543278:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137477.543489:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990107776 00000100:00100000:0.0:1783137477.543497:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990107776 00000100:00100000:0.0:1783137477.543548:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137477.543558:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990107776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137477.543589:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137477.543640:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990107776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137477.543647:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1783137477.543762:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970985321500 x1869754990107776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137477.543789:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990107776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137478.119010:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137478.355267:0:9141:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.85 00010000:00010000:3.0:1783137479.144980:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137480.166912:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137480.727631:0:9238:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.85 00010000:00010000:1.0:1783137481.203129:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137481.645358:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990107904:0@lo:400:kworker.0 00000100:00100000:2.0:1783137481.645426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137481.646110:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990108416:0@lo:400:kworker.0 00000100:00100000:2.0:1783137481.646221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137481.646251:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783137481.646272:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990108032:0@lo:400:kworker.0 00000100:00100000:2.0:1783137481.646298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137481.646321:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990108544:0@lo:400:kworker.0 00000100:00100000:3.0:1783137481.646338:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990108416 00000100:00100000:3.0:1783137481.646347:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990108416 00000100:00100000:2.0:1783137481.646348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137481.646387:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990108160:0@lo:400:kworker.0 00000100:00100000:3.0:1783137481.646396:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990108032 00000100:00100000:3.0:1783137481.646400:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990108032 00000100:00100000:2.0:1783137481.646416:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137481.646421:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990108160 00000100:00100000:3.0:1783137481.646424:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990108160 00000100:00100000:2.0:1783137481.646433:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137481.646442:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990108288:0@lo:400:kworker.0 00000100:00100000:3.0:1783137481.646446:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783137481.646456:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990108416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137481.646512:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990108416:12345-0@lo:400:kworker.0 Request processed in 58us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137481.646519:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783137481.646534:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783137481.646540:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd01aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990108032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137481.646566:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd01aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990108032:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137481.646573:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783137481.646583:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783137481.646588:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd01a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990108160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137481.646614:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd01a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990108160:12345-0@lo:400:kworker.0 Request processed in 26us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137481.646620:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783137481.646865:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990107904 00000100:00100000:3.0:1783137481.646869:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990107904 00000100:00100000:3.0:1783137481.646904:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1783137481.646912:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990107904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137481.647232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137481.647275:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990108160:0@lo:400:kworker.0 00000100:00100000:2.0:1783137481.647303:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990108544 00000100:00100000:2.0:1783137481.647307:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990108544 00000100:00100000:2.0:1783137481.647336:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990108288 00000100:00100000:2.0:1783137481.647339:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990108288 00000100:00100000:2.0:1783137481.647358:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783137481.647364:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990108544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137481.647399:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990108544:12345-0@lo:400:kworker.0 Request processed in 35us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137481.647407:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783137481.647421:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783137481.647428:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990108288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137481.647436:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990107904:12345-0@lo:400:kworker.0 Request processed in 523us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137481.647444:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783137481.647470:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990108288:12345-0@lo:400:kworker.0 Request processed in 41us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137481.647721:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783137481.647757:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990108032:0@lo:400:kworker.0 00010000:00080000:2.0:1783137481.647770:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc9d4e00 x1869754990108544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137481.647816:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990108544:0@lo:400:kworker.0 00000100:00100000:2.0:1783137481.647829:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990107904:0@lo:400:kworker.0 00000100:00100000:2.0:1783137481.647839:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990108416:0@lo:400:kworker.0 00010000:00080000:2.0:1783137481.647881:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bc9d5880 x1869754990108288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137481.647891:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990108288:0@lo:400:kworker.0 00000100:00080000:1.0:1783137481.649415:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137481.649423:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137481.649426:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137482.151171:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137482.151194:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990108672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137482.151255:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137482.151518:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990108672 00000100:00100000:0.0:1783137482.151525:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990108672 00000100:00100000:0.0:1783137482.151585:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783137482.151595:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990108672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137482.151628:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137482.151695:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990108672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137482.151716:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1783137482.151931:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b7ca9880 x1869754990108672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137482.151950:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990108672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137482.215564:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137482.553156:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137482.553226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137482.553290:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974347392 00000100:00100000:3.0:1783137482.553300:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974347392 00000100:00100000:3.0:1783137482.553370:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:3.0:1783137482.553381:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974347392:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137482.553455:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974347392:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137482.553463:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00080000:1.0:1783137482.553872:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137482.554916:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974347264 00000100:00100000:0.0:1783137482.554926:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974347264 00000100:00100000:0.0:1783137482.554975:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 201 00000100:00100000:0.0:1783137482.554999:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2353:x1869754974347264:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137482.555204:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2353:x1869754974347264:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 206us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137482.555213:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 201 00000100:00100000:3.0:1783137482.663964:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990108800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137482.664031:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137482.664082:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990108800 00000100:00100000:2.0:1783137482.664091:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990108800 00000100:00100000:2.0:1783137482.664140:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783137482.664150:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990108800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137482.664184:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137482.664229:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990108800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137482.664236:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783137482.664317:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970985321880 x1869754990108800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137482.664336:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990108800:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1783137482.936239:0:9335:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.85 00010000:00010000:1.0:1783137483.238999:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137484.237996:0:9383:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 3 23:58:02 EDT 2026 00010000:00010000:0.0:1783137484.262907:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137485.289221:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137486.316193:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137486.763100:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990109184:0@lo:400:kworker.0 00000100:00100000:1.0:1783137486.763161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137486.763209:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137486.763214:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990109312:0@lo:400:kworker.0 00000100:00100000:1.0:1783137486.763236:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137486.763294:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990109056:0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.763321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137486.763348:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990109568:0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.763367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137486.763387:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783137486.763392:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990108928:0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.763415:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137486.763437:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990109440:0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.763457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137486.763495:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990109184 00000100:00100000:0.0:1783137486.763502:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990109184 00000100:00100000:0.0:1783137486.764680:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990109056 00000100:00100000:0.0:1783137486.764689:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990109056 00000100:00100000:0.0:1783137486.764712:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990109440 00000100:00100000:0.0:1783137486.764725:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990109440 00000100:00100000:0.0:1783137486.764761:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783137486.764772:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990109184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.764864:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990109184:12345-0@lo:400:kworker.0 Request processed in 94us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137486.764872:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783137486.764887:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783137486.764893:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990109056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.764924:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990109056:12345-0@lo:400:kworker.0 Request processed in 32us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137486.764931:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783137486.764941:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783137486.764948:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990109440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.764974:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990109440:12345-0@lo:400:kworker.0 Request processed in 27us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137486.764980:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783137486.765000:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990108928 00000100:00100000:0.0:1783137486.765004:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990108928 00000100:00100000:0.0:1783137486.765030:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783137486.765036:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990108928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.765064:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990108928:12345-0@lo:400:kworker.0 Request processed in 29us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137486.765070:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1783137486.765098:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137486.765133:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990109184:0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.765161:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990108928:0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.765182:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990109440:0@lo:400:kworker.0 00000100:00100000:0.0:1783137486.765192:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990109056:0@lo:400:kworker.0 00000100:00100000:2.0:1783137486.765292:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990109312 00000100:00100000:2.0:1783137486.765296:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990109312 00000100:00100000:2.0:1783137486.765334:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990109568 00000100:00100000:2.0:1783137486.765337:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990109568 00000100:00100000:2.0:1783137486.765354:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783137486.765360:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990109312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137486.765398:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990109312:12345-0@lo:400:kworker.0 Request processed in 39us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137486.765404:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783137486.765416:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783137486.765430:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990109568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137486.765466:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990109568:12345-0@lo:400:kworker.0 Request processed in 38us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137486.765483:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1783137486.765519:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b7cab800 x1869754990109312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137486.765530:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990109312:0@lo:400:kworker.0 00010000:00080000:2.0:1783137486.765566:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b7caa680 x1869754990109568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137486.765574:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990109568:0@lo:400:kworker.0 00000100:00080000:0.0:1783137486.765666:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137486.765668:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137487.271579:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137487.271602:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990109696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137487.271667:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137487.271700:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990109696 00000100:00100000:2.0:1783137487.271709:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990109696 00000100:00100000:2.0:1783137487.271763:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783137487.271772:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990109696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783137487.271887:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137487.271985:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990109696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 214us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137487.271993:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1783137487.273620:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b7ca8e00 x1869754990109696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137487.273654:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990109696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137487.334954:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137487.669992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137487.670141:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974347520 00000100:00100000:0.0:1783137487.670157:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974347520 00000100:00100000:0.0:1783137487.670207:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:0.0:1783137487.670227:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2351:x1869754974347520:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137487.670295:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2351:x1869754974347520:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137487.670303:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:1.0:1783137487.670703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137487.670758:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974347648 00000100:00100000:0.0:1783137487.670763:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974347648 00000100:00100000:0.0:1783137487.670838:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:0.0:1783137487.670846:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974347648:12345-192.168.203.36@tcp:400:kworker.0 00000100:00080000:3.0:1783137487.670864:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137487.670883:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974347648:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137487.670906:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:2.0:1783137487.785407:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137487.785430:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990109824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137487.785508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137487.785819:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990109824 00000100:00100000:1.0:1783137487.785827:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990109824 00000100:00100000:1.0:1783137487.785875:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783137487.785883:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990109824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137487.785928:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137487.785980:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990109824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137487.785987:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1783137487.786074:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a80000 x1869754990109824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137487.786092:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990109824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137488.362845:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137489.382941:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137490.408393:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137491.431280:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137491.885167:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990109952:0@lo:400:kworker.0 00000100:00100000:2.0:1783137491.885227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137491.885339:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990109952 00000100:00100000:0.0:1783137491.885348:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990109952 00000100:00100000:1.0:1783137491.885377:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990110080:0@lo:400:kworker.0 00000100:00100000:1.0:1783137491.885409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137491.885416:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783137491.885427:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990109952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137491.885457:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990110080 00000100:00100000:1.0:1783137491.885462:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990110080 00000100:00100000:1.0:1783137491.885490:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137491.885496:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990110080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137491.885542:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990110080:12345-0@lo:400:kworker.0 Request processed in 45us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137491.885549:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137491.885597:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990110080:0@lo:400:kworker.0 00000100:00100000:3.0:1783137491.885954:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137491.885962:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990110208:0@lo:400:kworker.0 00000100:00100000:3.0:1783137491.885988:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137491.886012:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990110208 00000100:00100000:3.0:1783137491.886015:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990110208 00000100:00100000:3.0:1783137491.886044:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783137491.886050:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990110208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137491.886078:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990110208:12345-0@lo:400:kworker.0 Request processed in 29us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137491.886083:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1783137491.886098:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137491.886115:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990110208:0@lo:400:kworker.0 00000100:00100000:3.0:1783137491.886138:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990110336:0@lo:400:kworker.0 00000100:00100000:3.0:1783137491.886294:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137491.886373:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990110336 00000100:00100000:1.0:1783137491.886376:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990110336 00000100:00100000:1.0:1783137491.886409:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783137491.886415:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990110336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137491.886455:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990110336:12345-0@lo:400:kworker.0 Request processed in 41us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137491.886460:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783137491.886474:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990110592:0@lo:400:kworker.0 00000100:00100000:1.0:1783137491.886491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137491.886504:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137491.886507:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990110464:0@lo:400:kworker.0 00000100:00100000:1.0:1783137491.886538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137491.886555:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990110464 00000100:00100000:1.0:1783137491.886558:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990110464 00000100:00100000:1.0:1783137491.886588:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783137491.886593:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990110464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137491.886622:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990110464:12345-0@lo:400:kworker.0 Request processed in 28us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137491.886626:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1783137491.886663:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf236300 x1869754990110336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137491.886673:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990110336:0@lo:400:kworker.0 00000100:00100000:1.0:1783137491.886696:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990110464:0@lo:400:kworker.0 00000100:00080000:3.0:1783137491.886943:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137491.886947:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137491.887875:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990110592 00000100:00100000:3.0:1783137491.887882:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990110592 00000100:00080000:1.0:1783137491.887978:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783137491.888021:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783137491.888030:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990110592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137491.888084:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990110592:12345-0@lo:400:kworker.0 Request processed in 57us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137491.888089:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1783137491.888133:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf234e00 x1869754990110592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137491.888144:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990110592:0@lo:400:kworker.0 00000100:00100000:0.0:1783137491.899728:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990109952:12345-0@lo:400:kworker.0 Request processed in 14295us (14491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137491.899743:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783137491.901721:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990109952:0@lo:400:kworker.0 00000100:00100000:0.0:1783137492.392781:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137492.392820:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990110720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137492.392887:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137492.394740:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990110720 00000100:00100000:0.0:1783137492.394751:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990110720 00000100:00100000:0.0:1783137492.394815:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137492.394825:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990110720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137492.394865:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137492.395531:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990110720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 705us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137492.395540:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1783137492.395589:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a80000 x1869754990110720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137492.395618:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990110720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137492.454983:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137492.789291:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137492.790487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137492.790531:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974347776 00000100:00100000:2.0:1783137492.790540:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974347776 00000100:00100000:2.0:1783137492.790588:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:2.0:1783137492.790598:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2354:x1869754974347776:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137492.790666:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2354:x1869754974347776:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 69us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137492.790674:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:3.0:1783137492.791461:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974347904 00000100:00100000:3.0:1783137492.791468:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974347904 00000100:00100000:3.0:1783137492.791527:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:3.0:1783137492.791535:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2354:x1869754974347904:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137492.791587:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2354:x1869754974347904:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 52us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137492.791593:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00080000:2.0:1783137492.792936:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137492.903062:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990110848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137492.903134:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137492.903283:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990110848 00000100:00100000:1.0:1783137492.903290:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990110848 00000100:00100000:1.0:1783137492.903345:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783137492.903354:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990110848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137492.903388:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137492.906079:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990110848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2717us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137492.906093:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1783137492.909284:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a80000 x1869754990110848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137492.909307:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990110848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137493.479071:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137494.502945:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137495.534326:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137496.551253:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137496.999073:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990110976:0@lo:400:kworker.0 00000100:00100000:1.0:1783137496.999148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137496.999267:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990110976 00000100:00100000:0.0:1783137496.999274:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990110976 00000100:00100000:0.0:1783137496.999326:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783137496.999334:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990110976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137496.999821:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990111104:0@lo:400:kworker.0 00000100:00100000:2.0:1783137496.999822:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990111360:0@lo:400:kworker.0 00000100:00100000:3.0:1783137496.999853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137496.999853:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137496.999884:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783137496.999890:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990111232:0@lo:400:kworker.0 00000100:00100000:2.0:1783137496.999910:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137496.999937:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990111360 00000100:00100000:2.0:1783137496.999941:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990111360 00000100:00100000:2.0:1783137496.999972:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783137496.999979:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990111360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137497.000011:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990111360:12345-0@lo:400:kworker.0 Request processed in 33us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137497.000029:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783137497.000051:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990111104 00000100:00100000:2.0:1783137497.000054:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990111104 00000100:00100000:2.0:1783137497.000072:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990111232 00000100:00100000:2.0:1783137497.000074:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990111232 00000100:00100000:2.0:1783137497.000090:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783137497.000095:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990111104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137497.000122:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990111104:12345-0@lo:400:kworker.0 Request processed in 26us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137497.000128:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783137497.000137:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783137497.000143:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990111232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137497.000161:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990111232:12345-0@lo:400:kworker.0 Request processed in 20us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137497.000167:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1783137497.000180:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783137497.000184:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137497.000215:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990111232:0@lo:400:kworker.0 00010000:00080000:2.0:1783137497.000227:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf234700 x1869754990111360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137497.000238:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990111360:0@lo:400:kworker.0 00000100:00100000:0.0:1783137497.001184:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990110976:12345-0@lo:400:kworker.0 Request processed in 1845us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137497.001195:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783137497.001307:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990110976:0@lo:400:kworker.0 00000100:00100000:1.0:1783137497.001340:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990111488:0@lo:400:kworker.0 00000100:00100000:1.0:1783137497.001376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137497.001495:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990111488 00000100:00100000:2.0:1783137497.001501:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990111488 00000100:00100000:2.0:1783137497.001583:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783137497.001592:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990111488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137497.001644:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990111488:12345-0@lo:400:kworker.0 Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137497.001651:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1783137497.001702:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137497.001732:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990111488:0@lo:400:kworker.0 00000100:00100000:3.0:1783137497.003163:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990111104:0@lo:400:kworker.0 00000100:00100000:3.0:1783137497.003176:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990111616:0@lo:400:kworker.0 00000100:00100000:3.0:1783137497.003221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137497.003371:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990111616 00000100:00100000:1.0:1783137497.003377:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990111616 00000100:00100000:1.0:1783137497.003655:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783137497.003664:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990111616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137497.003906:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990111616:12345-0@lo:400:kworker.0 Request processed in 243us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137497.003913:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1783137497.003967:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783137497.004111:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bf236300 x1869754990111616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137497.004123:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990111616:0@lo:400:kworker.0 00000100:00100000:2.0:1783137497.511005:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990111744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137497.511238:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137497.511362:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990111744 00000100:00100000:3.0:1783137497.511369:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990111744 00000100:00100000:3.0:1783137497.511416:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783137497.511425:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990111744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137497.511635:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137497.511701:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990111744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 277us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137497.511709:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1783137497.511785:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a80380 x1869754990111744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137497.511824:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990111744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137497.575209:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137497.909267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137497.909312:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137497.909400:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974348032 00000100:00100000:1.0:1783137497.909409:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974348032 00000100:00100000:1.0:1783137497.909469:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:1.0:1783137497.909481:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2353:x1869754974348032:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137497.909483:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974348160 00000100:00100000:3.0:1783137497.909491:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974348160 00000100:00100000:3.0:1783137497.909547:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:3.0:1783137497.909561:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974348160:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137497.909561:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2353:x1869754974348032:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137497.909574:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:3.0:1783137497.909617:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974348160:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 62us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137497.909624:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00080000:3.0:1783137497.909648:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137498.027931:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137498.027954:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990111872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137498.028016:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137498.028133:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990111872 00000100:00100000:0.0:1783137498.028141:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990111872 00000100:00100000:0.0:1783137498.028203:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783137498.028213:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990111872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137498.028247:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137498.028289:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990111872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137498.028295:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1783137498.028445:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137498.028481:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a81f80 x1869754990111872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137498.028498:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990111872:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1783137498.513941:0:10012:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:58:16 (1783137496) === 00010000:00010000:3.0:1783137498.599000:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137498.990079:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137498.990262:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974348288 00000100:00100000:0.0:1783137498.990273:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974348288 00000100:00100000:0.0:1783137498.990327:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 208 00000100:00100000:0.0:1783137498.990337:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:8129:x1869754974348288:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783137498.990353:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137498.990391:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980031400/0x88def104ac6749f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72704 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137498.990420:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980031400/0x88def104ac6749f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72704 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137498.990431:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980031400/0x88def104ac6749f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72704 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137498.990440:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980031400, rc 0) 00000100:00100000:0.0:1783137498.990744:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8129:x1869754974348288:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 407us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137498.990752:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 208 00000100:00100000:1.0:1783137498.995264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137498.995367:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974348416 00000100:00100000:2.0:1783137498.995377:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974348416 00000100:00100000:2.0:1783137498.995438:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 209 00000100:00100000:2.0:1783137498.995449:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8129:x1869754974348416:12345-192.168.203.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783137498.995828:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8129:x1869754974348416:12345-192.168.203.36@tcp:501:mount.lustre.0 Request processed in 379us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137498.995837:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 209 00000100:00100000:2.0:1783137498.997983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137498.998247:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974348544 00000100:00100000:0.0:1783137498.998256:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974348544 00000100:00100000:0.0:1783137498.998345:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 210 00000100:00100000:0.0:1783137498.998355:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8129:x1869754974348544:12345-192.168.203.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783137498.998578:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8129:x1869754974348544:12345-192.168.203.36@tcp:503:mount.lustre.0 Request processed in 223us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137498.998587:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 210 00000100:00100000:3.0:1783137499.000747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137499.001520:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974348672 00000100:00100000:2.0:1783137499.001532:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974348672 00000100:00100000:2.0:1783137499.001574:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 211 00000100:00100000:2.0:1783137499.001584:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8133:x1869754974348672:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783137499.001970:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8133:x1869754974348672:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 386us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137499.001979:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 211 00000100:00100000:1.0:1783137499.013777:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137499.014332:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974348800 00000100:00100000:2.0:1783137499.014341:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974348800 00000100:00100000:2.0:1783137499.014399:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 212 00000100:00100000:2.0:1783137499.014409:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8133:x1869754974348800:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783137499.015135:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8133:x1869754974348800:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 723us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137499.015145:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 212 00000100:00100000:3.0:1783137499.024761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137499.026707:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974348928 00000100:00100000:0.0:1783137499.026721:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974348928 00000100:00100000:0.0:1783137499.026856:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 213 00000100:00100000:0.0:1783137499.026878:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:8129:x1869754974348928:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783137499.026895:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137499.026911:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980031800/0x88def104ac6749f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7272e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137499.026973:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980031800/0x88def104ac6749f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7272e expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137499.026984:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980031800/0x88def104ac6749f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7272e expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137499.026993:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980031800, rc 0) 00000100:00100000:0.0:1783137499.027059:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:8129:x1869754974348928:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 194us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137499.027066:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 213 00000100:00100000:3.0:1783137499.030955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137499.031128:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974349056 00000100:00100000:2.0:1783137499.031138:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974349056 00000100:00100000:2.0:1783137499.031244:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:2.0:1783137499.031255:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:8129:x1869754974349056:12345-192.168.203.36@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783137499.031283:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783137499.031305:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783137499.031310:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783137499.031313:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783137499.031315:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1783137499.033127:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:8129:x1869754974349056:12345-192.168.203.36@tcp:256:mount.lustre.0 Request processed in 1864us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137499.033147:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:3.0:1783137499.038343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137499.038532:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974349184 00000100:00100000:0.0:1783137499.038541:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974349184 00000100:00100000:0.0:1783137499.038642:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 215 00000100:00100000:0.0:1783137499.038664:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:8129:x1869754974349184:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783137499.038681:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137499.038698:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72735 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137499.038726:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72735 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137499.038739:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72735 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137499.038767:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980031200, rc 0) 00000100:00100000:0.0:1783137499.039104:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:8129:x1869754974349184:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 451us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137499.039111:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 215 00000100:00100000:3.0:1783137499.041540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137499.041895:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974349312 00000100:00100000:0.0:1783137499.041904:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974349312 00000100:00100000:0.0:1783137499.042003:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 216 00000100:00100000:0.0:1783137499.042014:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:8129:x1869754974349312:12345-192.168.203.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783137499.042281:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:8129:x1869754974349312:12345-192.168.203.36@tcp:501:mount.lustre.0 Request processed in 269us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137499.042290:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 216 00000100:00100000:2.0:1783137499.044238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137499.044510:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974349440 00000100:00100000:0.0:1783137499.044518:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974349440 00000100:00100000:0.0:1783137499.044565:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 217 00000100:00100000:0.0:1783137499.044574:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:8129:x1869754974349440:12345-192.168.203.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783137499.044940:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:8129:x1869754974349440:12345-192.168.203.36@tcp:503:mount.lustre.0 Request processed in 214us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137499.044950:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 217 00000100:00100000:3.0:1783137499.048258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137499.048743:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974349568 00000100:00100000:0.0:1783137499.048753:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974349568 00000100:00100000:0.0:1783137499.048841:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 218 00000100:00100000:0.0:1783137499.048852:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:8136:x1869754974349568:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137499.049251:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:8136:x1869754974349568:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 399us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137499.049270:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 218 00000100:00100000:3.0:1783137499.054010:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137499.054241:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974349696 00000100:00100000:1.0:1783137499.054249:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974349696 00000100:00100000:1.0:1783137499.054304:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 219 00000100:00100000:1.0:1783137499.054314:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:8136:x1869754974349696:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783137499.054573:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:8136:x1869754974349696:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 259us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137499.054582:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 219 00000100:00100000:1.0:1783137499.064127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137499.064254:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974349824 00000100:00100000:2.0:1783137499.064264:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974349824 00000100:00100000:2.0:1783137499.064309:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:2.0:1783137499.064317:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1869754974349824:12345-192.168.203.36@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783137499.064342:0:7113:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 635ac0b3-e465-4842-aece-61b6c0568a2a@192.168.203.36@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:2.0:1783137499.064379:0:7113:0:(genops.c:1406:class_connect()) connect: client 635ac0b3-e465-4842-aece-61b6c0568a2a, cookie 0x88def104ac674a07 00000004:00100000:2.0:1783137499.064406:0:7113:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783137499.064626:0:7113:0:(import.c:65:import_set_state_nolock()) ffff9709b7941000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783137499.064699:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2350:x1869754974349824:12345-192.168.203.36@tcp:38:mount.lustre.0 Request processed in 382us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137499.064707:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:3.0:1783137499.072765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137499.072990:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974350208 00000100:00100000:2.0:1783137499.073000:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974350208 00000100:00100000:2.0:1783137499.073085:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:2.0:1783137499.073096:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974350208:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137499.073175:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974350208:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 81us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137499.073183:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00080000:1.0:1783137499.073768:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137499.081143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137499.081193:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137499.084370:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974349952 00000100:00100000:1.0:1783137499.084384:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974349952 00000100:00080000:3.0:1783137499.084604:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137499.084651:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974350080 00000100:00100000:1.0:1783137499.084667:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974350080 00000100:00100000:1.0:1783137499.084739:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:1.0:1783137499.084750:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+7:0:x1869754974349952:12345-192.168.203.36@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783137499.084816:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783137499.084911:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+7:0:x1869754974349952:12345-192.168.203.36@tcp:41:mount.lustre.0 Request processed in 163us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137499.084919:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:1.0:1783137499.084951:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:1.0:1783137499.084959:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+6:8129:x1869754974350080:12345-192.168.203.36@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783137499.084971:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783137499.084993:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+6:8129:x1869754974350080:12345-192.168.203.36@tcp:41:mount.lustre.0 Request processed in 36us (3801us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137499.084999:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:1.0:1783137499.089695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137499.089855:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974350336 00000100:00100000:2.0:1783137499.089930:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974350336 00000100:00100000:2.0:1783137499.089987:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:2.0:1783137499.089998:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+6:8129:x1869754974350336:12345-192.168.203.36@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783137499.090727:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+6:8129:x1869754974350336:12345-192.168.203.36@tcp:40:mount.lustre.0 Request processed in 728us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137499.090737:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:3.0:1783137499.093377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137499.093417:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137499.093442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137499.093507:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974350720 00000100:00100000:2.0:1783137499.093515:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974350720 00000100:00100000:2.0:1783137499.093562:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:2.0:1783137499.093572:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+6:8129:x1869754974350720:12345-192.168.203.36@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783137499.093891:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783137499.094346:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974350464 00000100:00100000:0.0:1783137499.094352:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974350464 00000100:00100000:0.0:1783137499.094381:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974350592 00000100:00100000:3.0:1783137499.094466:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:3.0:1783137499.094474:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1869754974350464:12345-192.168.203.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783137499.094497:0:8200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 635ac0b3-e465-4842-aece-61b6c0568a2a@192.168.203.36@tcp t0 exp 0000000000000000 cur 254 last 0 00000100:00100000:2.0:1783137499.094503:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+6:8129:x1869754974350720:12345-192.168.203.36@tcp:33:mount.lustre.0 Request processed in 932us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137499.094511:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:0.0:1783137499.094581:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974350592 00000020:00000080:3.0:1783137499.095975:0:8200:0:(genops.c:1406:class_connect()) connect: client 635ac0b3-e465-4842-aece-61b6c0568a2a, cookie 0x88def104ac674a0e 00002000:00100000:3.0:1783137499.095993:0:8200:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 635ac0b3-e465-4842-aece-61b6c0568a2a/ffff9709b7c73000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783137499.096007:0:8200:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783137499.096243:0:8200:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783137499.096276:0:8200:0:(import.c:65:import_set_state_nolock()) ffff9709b7c71800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137499.096330:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2350:x1869754974350464:12345-192.168.203.36@tcp:8:mount.lustre.0 Request processed in 1856us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137499.096340:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:3.0:1783137499.096366:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:3.0:1783137499.096372:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1869754974350592:12345-192.168.203.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783137499.096395:0:8200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 635ac0b3-e465-4842-aece-61b6c0568a2a@192.168.203.36@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1783137499.096412:0:8200:0:(genops.c:1406:class_connect()) connect: client 635ac0b3-e465-4842-aece-61b6c0568a2a, cookie 0x88def104ac674a15 00002000:00100000:3.0:1783137499.096418:0:8200:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 635ac0b3-e465-4842-aece-61b6c0568a2a/ffff9709b7c76800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783137499.096424:0:8200:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783137499.098899:0:8200:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783137499.098947:0:8200:0:(import.c:65:import_set_state_nolock()) ffff9709b7c77000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137499.099029:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2350:x1869754974350592:12345-192.168.203.36@tcp:8:mount.lustre.0 Request processed in 2653us (5584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137499.099039:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00010000:00010000:1.0:1783137499.625360:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783137500.649948:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 635ac0b3-e465-4842-aece-61b6c0568a2a 00010000:00010000:3.0:1783137500.652222:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137501.678820:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137502.119507:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990112000:0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.119580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137502.119627:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990112512:0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.119666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137502.119687:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783137502.119693:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990112128:0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.119712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137502.119729:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990112640:0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.119752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137502.119783:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990112256:0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.119828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137502.119845:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137502.119850:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990112384:0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.119871:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137502.119903:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990112000 00000100:00100000:0.0:1783137502.119910:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990112000 00000100:00100000:0.0:1783137502.119955:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783137502.119964:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990112000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.120012:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990112000:12345-0@lo:400:kworker.0 Request processed in 50us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137502.120029:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783137502.120062:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990112512 00000100:00100000:0.0:1783137502.120066:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990112512 00000100:00100000:0.0:1783137502.120098:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990112128 00000100:00100000:0.0:1783137502.120102:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990112128 00000100:00100000:0.0:1783137502.120114:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990112256 00000100:00100000:0.0:1783137502.120116:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990112256 00000100:00100000:0.0:1783137502.120130:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783137502.120135:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990112512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.120166:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990112512:12345-0@lo:400:kworker.0 Request processed in 30us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137502.120172:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783137502.120185:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783137502.120190:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990112128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.120214:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990112128:12345-0@lo:400:kworker.0 Request processed in 24us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137502.121324:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783137502.121358:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783137502.121369:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990112256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.121501:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990112256:12345-0@lo:400:kworker.0 Request processed in 135us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137502.121508:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783137502.121532:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990112640 00000100:00100000:0.0:1783137502.121537:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990112640 00000100:00100000:0.0:1783137502.121568:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990112384 00000100:00100000:0.0:1783137502.121571:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990112384 00000100:00100000:0.0:1783137502.121591:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783137502.121605:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990112640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.121649:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990112640:12345-0@lo:400:kworker.0 Request processed in 45us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137502.121656:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783137502.121667:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783137502.121674:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990112384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.121701:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990112384:12345-0@lo:400:kworker.0 Request processed in 29us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137502.121706:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1783137502.121733:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137502.121737:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137502.121739:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137502.121781:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990112128:0@lo:400:kworker.0 00010000:00080000:0.0:1783137502.121811:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac3800 x1869754990112640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137502.121822:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990112640:0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.121833:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990112000:0@lo:400:kworker.0 00000100:00100000:0.0:1783137502.121844:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990112512:0@lo:400:kworker.0 00010000:00080000:1.0:1783137502.122035:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a80380 x1869754990112384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137502.122045:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990112384:0@lo:400:kworker.0 00000100:00100000:1.0:1783137502.122057:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990112256:0@lo:400:kworker.0 00000001:00100000:2.0:1783137502.191871:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 635ac0b3-e465-4842-aece-61b6c0568a2a 00000001:00100000:2.0:1783137502.234567:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 635ac0b3-e465-4842-aece-61b6c0568a2a 00000100:00100000:1.0:1783137502.631346:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990112768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137502.631421:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137502.631604:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990112768 00000100:00100000:0.0:1783137502.631611:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990112768 00000100:00100000:0.0:1783137502.631665:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783137502.631674:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990112768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137502.631705:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1783137502.631754:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990112768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137502.631772:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1783137502.631881:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac3800 x1869754990112768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137502.631897:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990112768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137502.695020:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137503.143369:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137503.143391:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990112896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137503.143461:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137503.143691:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990112896 00000100:00100000:0.0:1783137503.143699:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990112896 00000100:00100000:0.0:1783137503.143745:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783137503.143754:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990112896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137503.143809:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137503.143865:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990112896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137503.143872:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1783137503.144230:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac3480 x1869754990112896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137503.144249:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990112896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137503.718992:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137504.571144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137504.571180:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137504.571217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137504.571237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137504.571257:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137504.571376:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974351232 00000100:00100000:3.0:1783137504.571385:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974351232 00000100:00100000:3.0:1783137504.571439:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974351360 00000100:00100000:3.0:1783137504.571443:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974351360 00000100:00100000:3.0:1783137504.571470:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:3.0:1783137504.571480:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351232:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137504.571546:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351232:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 68us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137504.571553:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:3.0:1783137504.571569:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:3.0:1783137504.571575:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351360:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137504.571600:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351360:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137504.571606:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00080000:3.0:1783137504.571632:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137504.571636:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137504.571824:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974350976 00000100:00100000:0.0:1783137504.571829:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974350976 00000100:00100000:0.0:1783137504.571859:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974351104 00000100:00100000:0.0:1783137504.571861:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974351104 00000100:00100000:0.0:1783137504.571879:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:0.0:1783137504.571886:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974350976:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137504.571922:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974350976:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 36us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137504.571929:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:0.0:1783137504.571941:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:0.0:1783137504.571947:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351104:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137504.571972:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351104:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 25us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137504.571978:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00080000:3.0:1783137504.574956:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137504.575950:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974350848 00000100:00100000:0.0:1783137504.575961:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974350848 00000100:00100000:0.0:1783137504.576005:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 221 00000100:00100000:0.0:1783137504.576021:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974350848:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137504.576091:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974350848:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 70us (4873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137504.576098:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 221 00000001:02000400:1.0:1783137504.597688:0:10208:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1783137504.750186:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137505.772036:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137506.791280:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137507.245634:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990113024:0@lo:400:kworker.0 00000100:00100000:3.0:1783137507.245697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137507.245738:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990113536:0@lo:400:kworker.0 00000100:00100000:3.0:1783137507.245780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137507.246276:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990113280:0@lo:400:kworker.0 00000100:00100000:1.0:1783137507.246311:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990113408:0@lo:400:kworker.0 00000100:00100000:1.0:1783137507.246337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137507.246953:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783137507.246962:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990113152:0@lo:400:kworker.0 00000100:00100000:3.0:1783137507.246989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137507.247006:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990113664:0@lo:400:kworker.0 00000100:00100000:3.0:1783137507.247028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137507.247055:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990113024 00000100:00100000:3.0:1783137507.247061:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990113024 00000100:00100000:0.0:1783137507.249435:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990113536 00000100:00100000:0.0:1783137507.249451:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990113536 00000100:00100000:0.0:1783137507.249506:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990113152 00000100:00100000:0.0:1783137507.249508:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990113152 00000100:00100000:0.0:1783137507.249529:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783137507.249537:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990113536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137507.249636:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990113536:12345-0@lo:400:kworker.0 Request processed in 98us (3854us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137507.249644:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783137507.249660:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783137507.249667:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990113152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137507.249695:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990113152:12345-0@lo:400:kworker.0 Request processed in 28us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137507.249700:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783137507.249721:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783137507.249728:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990113024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137507.249780:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990113024:12345-0@lo:400:kworker.0 Request processed in 53us (4083us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137507.249786:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1783137507.249931:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990113408 00000100:00100000:3.0:1783137507.249936:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990113408 00000100:00100000:3.0:1783137507.249965:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990113664 00000100:00100000:3.0:1783137507.249967:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990113664 00000100:00100000:3.0:1783137507.249991:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783137507.249998:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990113408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137507.250041:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990113408:12345-0@lo:400:kworker.0 Request processed in 44us (3703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137507.250047:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783137507.250059:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783137507.250064:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990113664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137507.250090:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990113664:12345-0@lo:400:kworker.0 Request processed in 26us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137507.250095:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783137507.250149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783137507.250216:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd074a80 x1869754990113408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137507.250229:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990113280 00000100:00100000:3.0:1783137507.250231:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990113408:0@lo:400:kworker.0 00000100:00100000:2.0:1783137507.250238:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990113280 00000100:00100000:2.0:1783137507.250762:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783137507.250773:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990113280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137507.250858:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990113280:12345-0@lo:400:kworker.0 Request processed in 87us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137507.250866:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783137507.251230:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990113280:0@lo:400:kworker.0 00000100:00080000:0.0:1783137507.251319:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137507.251324:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137507.251478:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137507.252577:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990113152:0@lo:400:kworker.0 00010000:00080000:0.0:1783137507.252593:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd077480 x1869754990113664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137507.252614:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990113664:0@lo:400:kworker.0 00000100:00100000:0.0:1783137507.252626:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990113024:0@lo:400:kworker.0 00000100:00100000:0.0:1783137507.252636:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990113536:0@lo:400:kworker.0 00000100:00100000:0.0:1783137507.755060:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137507.755091:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990113792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137507.755161:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137507.763928:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990113792 00000100:00100000:1.0:1783137507.763942:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990113792 00000100:00100000:1.0:1783137507.764030:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783137507.764041:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990113792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137507.764087:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1783137507.764292:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990113792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 252us (9129us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137507.764300:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1783137507.764411:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac1f80 x1869754990113792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137507.764431:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990113792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137507.815028:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137508.264108:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990113920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137508.264201:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137508.264319:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990113920 00000100:00100000:1.0:1783137508.264327:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990113920 00000100:00100000:1.0:1783137508.264378:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783137508.264388:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990113920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137508.264437:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137508.264487:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990113920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137508.264496:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1783137508.264582:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd074380 x1869754990113920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137508.264612:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990113920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783137508.839783:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137509.686574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137509.686642:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137509.686679:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137509.686706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137509.686731:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137509.687367:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974352000 00000100:00100000:3.0:1783137509.687377:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974352000 00000100:00100000:3.0:1783137509.687444:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974351872 00000100:00100000:3.0:1783137509.687448:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974351872 00000100:00100000:3.0:1783137509.687471:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:3.0:1783137509.687482:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974352000:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137509.687553:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974352000:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 73us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137509.687560:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:3.0:1783137509.687576:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:3.0:1783137509.687593:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351872:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137509.687619:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351872:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 28us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137509.687625:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:3.0:1783137509.687644:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974351744 00000100:00100000:3.0:1783137509.687648:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974351744 00000100:00100000:3.0:1783137509.687670:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974351616 00000100:00100000:3.0:1783137509.687673:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974351616 00000100:00100000:3.0:1783137509.687690:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:3.0:1783137509.687696:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351744:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137509.687722:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974351744:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137509.687729:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:3.0:1783137509.687740:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:3.0:1783137509.687747:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974351616:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137509.687770:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974351616:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 24us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137509.687784:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00080000:1.0:1783137509.688136:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783137509.688140:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137509.688143:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137509.688778:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974351488 00000100:00100000:0.0:1783137509.688786:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974351488 00000100:00100000:0.0:1783137509.688868:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 223 00000100:00100000:0.0:1783137509.688877:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974351488:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137509.688932:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974351488:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 56us (2367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137509.688939:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 223 00010000:00010000:1.0:1783137509.863097:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137510.887394:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137511.911961:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137512.361404:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990114048:0@lo:400:kworker.0 00000100:00100000:1.0:1783137512.361469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137512.361510:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990114560:0@lo:400:kworker.0 00000100:00100000:1.0:1783137512.361627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137512.362016:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990114304:0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.362052:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137512.362077:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137512.362084:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990114432:0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.362109:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137512.362208:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990114560 00000100:00100000:2.0:1783137512.362214:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990114560 00000100:00100000:2.0:1783137512.362260:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990114304 00000100:00100000:2.0:1783137512.362264:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990114304 00000100:00100000:2.0:1783137512.362285:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783137512.363045:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783137512.363060:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990114176:0@lo:400:kworker.0 00000100:00100000:1.0:1783137512.363105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137512.363123:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990114688:0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.363746:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990114560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.363815:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990114560:12345-0@lo:400:kworker.0 Request processed in 1523us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137512.363823:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783137512.363846:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990114176 00000100:00100000:2.0:1783137512.363851:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990114176 00000100:00100000:1.0:1783137512.364109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137512.364151:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990114560:0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.364979:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783137512.365001:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990114304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.365061:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990114304:12345-0@lo:400:kworker.0 Request processed in 64us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137512.365068:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783137512.365089:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783137512.365095:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990114176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.365131:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990114176:12345-0@lo:400:kworker.0 Request processed in 35us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137512.365136:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783137512.365159:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990114432 00000100:00100000:2.0:1783137512.365165:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990114432 00000100:00100000:2.0:1783137512.365196:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990114688 00000100:00100000:2.0:1783137512.365200:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990114688 00000100:00100000:2.0:1783137512.365221:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783137512.365227:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1af7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990114432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.365258:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1af7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990114432:12345-0@lo:400:kworker.0 Request processed in 32us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137512.365264:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783137512.365395:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783137512.365402:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990114688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.365429:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990114688:12345-0@lo:400:kworker.0 Request processed in 29us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137512.365434:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783137512.365680:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990114048 00000100:00100000:1.0:1783137512.365686:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990114048 00000100:00100000:1.0:1783137512.365719:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1783137512.365810:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990114048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137512.365848:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990114048:12345-0@lo:400:kworker.0 Request processed in 56us (4380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137512.365855:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:2.0:1783137512.368992:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137512.368999:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783137512.369002:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783137512.369058:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd076680 x1869754990114432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137512.369082:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990114432:0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.369099:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990114304:0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.369138:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990114176:0@lo:400:kworker.0 00010000:00080000:2.0:1783137512.369152:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd074a80 x1869754990114688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137512.369161:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990114688:0@lo:400:kworker.0 00000100:00100000:2.0:1783137512.369173:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990114048:0@lo:400:kworker.0 00000100:00100000:1.0:1783137512.871011:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137512.871034:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990114816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137512.871115:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137512.871534:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990114816 00000100:00100000:0.0:1783137512.871541:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990114816 00000100:00100000:0.0:1783137512.871605:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783137512.871614:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990114816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137512.871649:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1783137512.871714:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990114816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137512.871721:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1783137512.871835:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac1f80 x1869754990114816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137512.871854:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990114816:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137512.937911:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137513.389018:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137513.389039:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990114944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137513.389106:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137513.389170:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990114944 00000100:00100000:2.0:1783137513.389176:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990114944 00000100:00100000:2.0:1783137513.389222:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783137513.389231:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990114944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137513.389264:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137513.389305:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990114944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137513.389312:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1783137513.389352:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd6b7480 x1869754990114944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137513.389369:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990114944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783137513.959011:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137514.812003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137514.812039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137514.812064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137514.812082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137514.812104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137514.812149:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974352384 00000100:00100000:3.0:1783137514.812157:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974352384 00000100:00100000:3.0:1783137514.812206:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974352256 00000100:00100000:3.0:1783137514.812209:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974352256 00000100:00100000:3.0:1783137514.812234:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:3.0:1783137514.812244:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974352384:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137514.812325:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974352384:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137514.812333:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:3.0:1783137514.812349:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:3.0:1783137514.812356:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974352256:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137514.812382:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974352256:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137514.812388:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:3.0:1783137514.812406:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974352640 00000100:00100000:3.0:1783137514.812409:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974352640 00000100:00100000:3.0:1783137514.812433:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974352512 00000100:00100000:3.0:1783137514.812436:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974352512 00000100:00100000:3.0:1783137514.812468:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:3.0:1783137514.812474:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974352640:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137514.812500:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974352640:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137514.812506:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:3.0:1783137514.812517:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:3.0:1783137514.812523:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974352512:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137514.812554:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974352512:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137514.812560:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00080000:3.0:1783137514.812582:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137514.812586:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137514.812588:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137514.812933:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974352128 00000100:00100000:0.0:1783137514.812937:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974352128 00000100:00100000:0.0:1783137514.812968:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 225 00000100:00100000:0.0:1783137514.812974:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974352128:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137514.813004:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974352128:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 31us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137514.813010:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 225 00010000:00010000:3.0:1783137514.986630:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137516.007956:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137517.033824:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137517.479179:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990115200:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137517.479290:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990115712:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479313:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137517.479343:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783137517.479349:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990115072:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137517.479396:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990115584:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137517.479449:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990115328:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479472:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137517.479498:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137517.479503:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990115456:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479536:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137517.479544:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990115200 00000100:00100000:2.0:1783137517.479561:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990115200 00000100:00100000:0.0:1783137517.479569:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990115584 00000100:00100000:0.0:1783137517.479582:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990115584 00000100:00100000:2.0:1783137517.479608:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990115328 00000100:00100000:2.0:1783137517.479613:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990115328 00000100:00100000:0.0:1783137517.479619:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783137517.479630:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990115200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137517.479642:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783137517.479652:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990115584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479686:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990115200:12345-0@lo:400:kworker.0 Request processed in 57us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137517.479694:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783137517.479702:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990115584:12345-0@lo:400:kworker.0 Request processed in 51us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137517.479711:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783137517.479717:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783137517.479725:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990115328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479762:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990115328:12345-0@lo:400:kworker.0 Request processed in 38us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137517.479769:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783137517.479809:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990115328:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479818:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990115712 00000100:00100000:0.0:1783137517.479823:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990115712 00000100:00100000:0.0:1783137517.479859:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990115456 00000100:00100000:0.0:1783137517.479862:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990115456 00000100:00100000:0.0:1783137517.479884:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783137517.479892:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990115712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137517.479903:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783137517.479914:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990115456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.479928:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990115712:12345-0@lo:400:kworker.0 Request processed in 36us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137517.479935:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783137517.479960:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990115456:12345-0@lo:400:kworker.0 Request processed in 48us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137517.479967:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1783137517.479993:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac1500 x1869754990115456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137517.480004:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990115456:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.480042:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990115072 00000100:00100000:0.0:1783137517.480046:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990115072 00000100:00100000:0.0:1783137517.480080:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783137517.480086:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990115072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.480116:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990115072:12345-0@lo:400:kworker.0 Request processed in 30us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137517.480122:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1783137517.480161:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137517.480165:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137517.480167:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137517.480188:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990115072:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.480199:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990115584:0@lo:400:kworker.0 00000100:00100000:0.0:1783137517.480208:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990115200:0@lo:400:kworker.0 00010000:00080000:0.0:1783137517.480217:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac2d80 x1869754990115712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137517.480225:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990115712:0@lo:400:kworker.0 00000100:00100000:1.0:1783137517.991041:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137517.991066:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990115840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137517.991139:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137517.991493:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990115840 00000100:00100000:0.0:1783137517.991501:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990115840 00000100:00100000:0.0:1783137517.991560:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783137517.991570:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990115840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137517.991608:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1783137517.991666:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990115840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137517.991673:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1783137517.992031:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac2d80 x1869754990115840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137517.992050:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990115840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137518.055060:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137518.503768:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990115968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137518.503850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137518.503921:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990115968 00000100:00100000:3.0:1783137518.503929:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990115968 00000100:00100000:3.0:1783137518.503976:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783137518.503986:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990115968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137518.504021:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137518.504081:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990115968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137518.504089:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1783137518.504133:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b78cf100 x1869754990115968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137518.504149:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990115968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137519.079778:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137519.938777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137519.938845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137519.938871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137519.938899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137519.938911:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974352896 00000100:00100000:2.0:1783137519.938921:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974352896 00000100:00100000:1.0:1783137519.938942:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137519.938968:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974353024 00000100:00100000:1.0:1783137519.938973:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974353024 00000100:00100000:2.0:1783137519.938991:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:2.0:1783137519.939013:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974352896:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137519.939042:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974352768 00000100:00100000:3.0:1783137519.939048:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974352768 00000100:00100000:3.0:1783137519.939098:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 227 00000100:00100000:2.0:1783137519.939099:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974352896:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137519.939110:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974352768:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137519.939148:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974352768:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137519.939154:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 227 00000100:00080000:3.0:1783137519.940833:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137519.941212:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:1.0:1783137519.941227:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974353024:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137519.941300:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974353024:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 79us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137519.941308:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:1.0:1783137519.941333:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974353152 00000100:00100000:1.0:1783137519.941339:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974353152 00000100:00100000:1.0:1783137519.941373:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974353280 00000100:00100000:1.0:1783137519.941382:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974353280 00000100:00100000:1.0:1783137519.941408:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:1.0:1783137519.941414:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2350:x1869754974353152:12345-192.168.203.36@tcp:9:kworker.0 00000020:00000080:1.0:1783137519.941431:0:6618:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674a0e 00000100:00080000:1.0:1783137519.941441:0:6618:0:(import.c:65:import_set_state_nolock()) ffff9709b7c71800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783137519.941475:0:6618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1783137519.941589:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137519.941593:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137519.941780:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+2:2350:x1869754974353152:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 364us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137519.941787:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:1.0:1783137519.941819:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:1.0:1783137519.941826:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2350:x1869754974353280:12345-192.168.203.36@tcp:9:kworker.0 00000020:00000080:1.0:1783137519.941838:0:6618:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674a15 00000100:00080000:1.0:1783137519.941843:0:6618:0:(import.c:65:import_set_state_nolock()) ffff9709b7c77000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783137519.941865:0:6618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783137519.942039:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+2:2350:x1869754974353280:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 213us (3097us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137519.942046:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00010000:00010000:3.0:1783137519.942827:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137519.943985:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137519.950261:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 82 00010000:00010000:3.0:1783137520.103232:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137520.333396:0:10909:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1783137521.131284:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783137521.133914:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 635ac0b3-e465-4842-aece-61b6c0568a2a 00000020:00000080:3.0:1783137521.133923:0:6644:0:(genops.c:906:class_export_put()) final put ffff9709b7c73000/635ac0b3-e465-4842-aece-61b6c0568a2a 00000020:00000080:2.0:1783137521.133996:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c73000/635ac0b3-e465-4842-aece-61b6c0568a2a for lustre-OST0000 00000020:00000080:2.0:1783137521.134051:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7c71800 for lustre-OST0000 00010000:00010000:3.0:1783137522.152973:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137522.603891:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990116352:0@lo:400:kworker.0 00000100:00100000:3.0:1783137522.603953:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137522.604260:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137522.604269:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990116480:0@lo:400:kworker.0 00000100:00100000:3.0:1783137522.604437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137522.604493:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990116352 00000100:00100000:3.0:1783137522.604500:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990116352 00000100:00100000:3.0:1783137522.604551:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783137522.604560:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990116352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137522.604618:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990116352:12345-0@lo:400:kworker.0 Request processed in 60us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137522.604627:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1783137522.604651:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137522.604946:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990116352:0@lo:400:kworker.0 00000100:00100000:1.0:1783137522.606262:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990116480 00000100:00100000:1.0:1783137522.606273:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990116480 00000100:00100000:1.0:1783137522.606346:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783137522.606356:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990116480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137522.606430:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990116480:12345-0@lo:400:kworker.0 Request processed in 76us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137522.606437:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1783137522.606469:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783137522.606519:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b78cc700 x1869754990116480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137522.606532:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990116480:0@lo:400:kworker.0 00000100:00100000:0.0:1783137522.608813:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990116096:0@lo:400:kworker.0 00000100:00100000:0.0:1783137522.608877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137522.608923:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990116608:0@lo:400:kworker.0 00000100:00100000:0.0:1783137522.609022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137522.609049:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783137522.609057:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990116224:0@lo:400:kworker.0 00000100:00100000:0.0:1783137522.609079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137522.609107:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990116736:0@lo:400:kworker.0 00000100:00100000:0.0:1783137522.609132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137522.609164:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990116608 00000100:00100000:0.0:1783137522.609170:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990116608 00000100:00100000:0.0:1783137522.609223:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990116224 00000100:00100000:0.0:1783137522.609227:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990116224 00000100:00100000:0.0:1783137522.609246:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783137522.609253:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990116608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137522.609303:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869754990116608:12345-0@lo:400:kworker.0 Request processed in 50us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137522.609309:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783137522.609323:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783137522.609329:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990116224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137522.609357:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990116224:12345-0@lo:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137522.609363:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783137522.609378:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990116736 00000100:00100000:0.0:1783137522.609382:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990116736 00000100:00100000:0.0:1783137522.609403:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783137522.609409:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990116736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137522.609437:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990116736:12345-0@lo:400:kworker.0 Request processed in 28us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137522.609442:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783137522.609476:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990116224:0@lo:400:kworker.0 00010000:00080000:0.0:1783137522.609500:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b78cdf80 x1869754990116736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137522.609523:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990116736:0@lo:400:kworker.0 00000100:00100000:0.0:1783137522.609534:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990116608:0@lo:400:kworker.0 00000100:00100000:2.0:1783137522.610619:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990116096 00000100:00100000:2.0:1783137522.610630:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990116096 00000100:00100000:2.0:1783137522.610675:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1783137522.610686:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990116096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137522.610747:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990116096:12345-0@lo:400:kworker.0 Request processed in 64us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137522.610755:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1783137522.611189:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990116096:0@lo:400:kworker.0 00000100:00080000:1.0:1783137522.611609:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137522.611615:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1783137522.672420:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 635ac0b3-e465-4842-aece-61b6c0568a2a 00000020:00000080:2.0:1783137522.672430:0:7535:0:(genops.c:906:class_export_put()) final put ffff9709b7c76800/635ac0b3-e465-4842-aece-61b6c0568a2a 00000020:00000080:3.0:1783137522.675936:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c76800/635ac0b3-e465-4842-aece-61b6c0568a2a for lustre-OST0001 00000020:00000080:3.0:1783137522.675987:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7c77000 for lustre-OST0001 00000100:00100000:1.0:1783137523.111650:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990116864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137523.111727:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137523.111831:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990116864 00000100:00100000:3.0:1783137523.111839:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990116864 00000100:00100000:3.0:1783137523.111889:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783137523.111898:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990116864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137523.111931:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137523.115600:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990116864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3693us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137523.115615:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1783137523.115766:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac0700 x1869754990116864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137523.117374:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990116864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137523.179491:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783137523.572341:0:11058:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffad61d670 20000000:00000080:1.0:1783137523.572356:0:11058:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9709bce65c00 uarg=0000000000000000 20000000:01000000:1.0:1783137523.572387:0:11058:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783137523.572392:0:11058:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783137523.572396:0:11058:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783137523.573153:0:11059:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783137523.573222:0:11058:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783137523.582938:0:11058:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783137523.583109:0:11058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583130:0:11058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726fd expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583139:0:11058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6749c8 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583146:0:11058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6749d6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583152:0:11058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac6749e4 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583160:0:11058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72735 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583168:0:11058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583285:0:11058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72735 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583299:0:11058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72735 expref: 12 pid: 5807 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137523.583312:0:11058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990116992:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137523.583437:0:11058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6749e4 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583445:0:11058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6749e4 expref: 18 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137523.583454:0:11058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990117120:0@lo:104: 00000100:00100000:0.0:1783137523.583500:0:11058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783137523.583538:0:11058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6749d6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583546:0:11058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6749d6 expref: 18 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137523.583554:0:11058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990117248:0@lo:104: 00000100:00100000:0.0:1783137523.583573:0:11058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783137523.583600:0:11058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac6749c8 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583607:0:11058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac6749c8 expref: 18 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137523.583625:0:11058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990117376:0@lo:104: 00000100:00100000:0.0:1783137523.583646:0:11058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783137523.583663:0:11058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726fd expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.583672:0:11058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726fd expref: 12 pid: 5809 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137523.583680:0:11058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990117504:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137523.583701:0:11058:0:(client.c:2701:ptlrpc_set_wait()) set ffff970982d37a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137523.583764:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990117248 00000100:00100000:2.0:1783137523.583764:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990117120 00000100:00100000:3.0:1783137523.583771:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990117248 00000100:00100000:2.0:1783137523.583771:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990117120 00000100:00100000:2.0:1783137523.583825:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990117376 00000100:00100000:2.0:1783137523.583828:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990117376 00000100:00100000:3.0:1783137523.583830:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783137523.583838:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+5:11058:x1869754990117120:12345-0@lo:104: 00010000:00010000:3.0:1783137523.583850:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.583916:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137523.583922:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+5:11058:x1869754990117120:12345-0@lo:104: Request processed in 85us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137523.583929:0:11058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990117120:0@lo:104: 00010000:00010000:2.0:1783137523.583969:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137523.583976:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.583984:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051c00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137523.583988:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.583996:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137523.584002:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137523.584008:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783137523.584050:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.584057:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137523.584076:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.584083:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac6749e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6749eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.584093:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137523.584095:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137523.584096:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137523.584106:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990117632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137523.584136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137523.584168:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990117632 00000100:00100000:2.0:1783137523.584172:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990117632 00000100:00100000:3.0:1783137523.584180:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1783137523.584188:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6749e4 expref: 19 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137523.584196:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783137523.584201:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:11058:x1869754990117248:12345-0@lo:104: 00000100:00100000:2.0:1783137523.584205:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1783137523.584209:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137523.584222:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990117632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137523.584231:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137523.584235:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6749e4 expref: 19 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584241:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1783137523.584244:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6749e4 expref: 19 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137523.584245:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:11058:x1869754990117248:12345-0@lo:104: Request processed in 45us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137523.584251:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1783137523.584256:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488000/0x88def104ac6749eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6749e4 expref: 19 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137523.584264:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783137523.584268:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:11058:x1869754990117376:12345-0@lo:104: 00010000:00010000:2.0:1783137523.584273:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137523.584274:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584295:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783137523.584297:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+18:3309:x1869754990117632:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137523.584300:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:11058:x1869754990117376:12345-0@lo:104: Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137523.584303:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783137523.584304:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1783137523.584317:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783137523.584321:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584327:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0de00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137523.584335:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584343:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137523.584348:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990117632:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1783137523.584350:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137523.584355:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783137523.584361:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137523.584368:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584373:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137523.584389:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584394:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac6749d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6749dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584403:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137523.584404:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137523.584406:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137523.584413:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990117760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137523.584448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137523.584472:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137523.584475:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990117760 00000100:00100000:3.0:1783137523.584488:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990117760 00010000:00010000:2.0:1783137523.584488:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.584494:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050600 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137523.584497:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584500:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6749d6 expref: 18 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.584505:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137523.584511:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137523.584516:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1783137523.584518:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1783137523.584529:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137523.584530:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+18:3306:x1869754990117760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137523.584534:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137523.584537:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137523.584541:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6749d6 expref: 18 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.584544:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584549:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6749d6 expref: 18 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.584551:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd050600/0x88def104ac6749c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac6749cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137523.584558:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137523.584566:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137523.584567:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137523.584569:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137523.584574:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137523.584575:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137523.584578:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+18:3306:x1869754990117760:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137523.584584:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783137523.584603:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990117888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137523.584624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137523.584661:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990117760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137523.584668:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990117888 00000100:00100000:2.0:1783137523.584672:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990117888 00010000:00010000:2.0:1783137523.584685:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6749c8 expref: 18 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137523.584709:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783137523.584714:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+18:3307:x1869754990117888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137523.584721:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137523.584725:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac6749c8 expref: 18 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.584732:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac6749c8 expref: 18 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.584741:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137523.584765:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+18:3307:x1869754990117888:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137523.584770:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1783137523.584908:0:11058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd051000/0x88def104ac6749dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6749d6 expref: 17 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137523.584917:0:11058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990117248:0@lo:104: 00010000:00010000:0.0:1783137523.584925:0:11058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970980030a00/0x88def104ac6749cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac6749c8 expref: 16 pid: 5808 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137523.584933:0:11058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990117376:0@lo:104: 00000100:00100000:3.0:1783137523.585607:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990117888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137523.589853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137523.589889:0:11058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990116992:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137523.589901:0:11058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11058:1869754990117504:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137523.589935:0:11058:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137523.590003:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974353408 00000100:00100000:1.0:1783137523.590009:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974353408 00010000:00010000:1.0:1783137523.590042:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72735 expref: 13 pid: 5807 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137523.590077:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:1.0:1783137523.590085:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974353408:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137523.590111:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137523.590117:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72735 expref: 13 pid: 5807 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137523.590127:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72735 expref: 13 pid: 5807 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137523.590161:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970980031200/0x88def104ac674a00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72735 expref: 13 pid: 5807 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137523.590175:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137523.590227:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:2351:x1869754974353408:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 142us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137523.590235:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:1.0:1783137523.592638:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137523.593262:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974353536 00000100:00100000:2.0:1783137523.593283:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974353536 00010000:00010000:2.0:1783137523.593320:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726fd expref: 12 pid: 5809 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137523.593355:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:2.0:1783137523.593375:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:2351:x1869754974353536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137523.593389:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137523.593394:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726fd expref: 12 pid: 5809 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593406:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726fd expref: 12 pid: 5809 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593421:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488c00/0x88def104ac6749c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726fd expref: 12 pid: 5809 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593436:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593444:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593458:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593465:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593472:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593488:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593494:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137523.593498:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593512:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593532:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137523.593542:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137523.593596:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:2351:x1869754974353536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 222us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137523.593604:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00010000:00010000:0.0:1783137523.593906:0:11058:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.593926:0:11058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137523.593943:0:11058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd234c00/0x88def104ac674a1c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137523.625507:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137523.625531:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990118016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137523.625599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137523.627163:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990118016 00000100:00100000:0.0:1783137523.627174:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990118016 00000100:00100000:0.0:1783137523.627227:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783137523.627237:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990118016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137523.627272:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137523.627352:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990118016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137523.627360:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1783137523.627399:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a81c00 x1869754990118016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137523.627419:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990118016:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137524.199196:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137524.793979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137524.794019:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974353664 00000100:00100000:0.0:1783137524.794028:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974353664 00000100:00100000:0.0:1783137524.794071:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:0.0:1783137524.794081:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:5571:x1869754974353664:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137524.794098:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137524.794117:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7275f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137524.794144:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7275f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137524.794156:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7275f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137524.794172:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235e00, rc 0) 00000100:00100000:0.0:1783137524.794232:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974353664:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 153us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137524.794239:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:1.0:1783137524.802335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137524.802395:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974353792 00000100:00100000:2.0:1783137524.802403:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974353792 00000100:00100000:2.0:1783137524.802444:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 230 00000100:00100000:2.0:1783137524.802452:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974353792:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137524.802732:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974353792:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 279us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137524.802740:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 230 00000100:00100000:0.0:1783137524.807208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137524.807279:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974353920 00000100:00100000:2.0:1783137524.807288:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974353920 00000100:00100000:2.0:1783137524.807339:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:2.0:1783137524.807349:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974353920:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137524.807570:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974353920:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 221us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137524.807579:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:1.0:1783137524.821836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137524.821916:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974354048 00000100:00100000:3.0:1783137524.821926:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974354048 00000100:00100000:3.0:1783137524.821984:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 232 00000100:00100000:3.0:1783137524.821992:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974354048:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137524.822009:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137524.822026:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72766 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137524.822053:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72766 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137524.822064:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72766 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137524.822072:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004e00, rc 0) 00000100:00100000:3.0:1783137524.822126:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974354048:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 134us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137524.822132:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 232 00000100:00100000:3.0:1783137524.824604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137524.824674:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974354176 00000100:00100000:2.0:1783137524.824691:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974354176 00000100:00100000:2.0:1783137524.824765:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:2.0:1783137524.824774:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974354176:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137524.825066:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974354176:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 292us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137524.825074:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:1.0:1783137524.827143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137524.827205:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974354304 00000100:00100000:2.0:1783137524.827213:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974354304 00000100:00100000:2.0:1783137524.827263:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 234 00000100:00100000:2.0:1783137524.827271:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974354304:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137524.827457:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974354304:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 185us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137524.827464:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 234 00000100:00100000:1.0:1783137525.045560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137525.045599:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137525.045628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137525.045682:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974354432 00000100:00100000:3.0:1783137525.045691:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974354432 00000100:00100000:3.0:1783137525.045745:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 235 00000100:00100000:3.0:1783137525.045755:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974354432:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137525.045852:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974354432:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 98us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137525.045860:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 235 00000100:00100000:0.0:1783137525.046218:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974354560 00000100:00100000:0.0:1783137525.046223:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974354560 00000100:00100000:0.0:1783137525.046273:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974354688 00000100:00100000:0.0:1783137525.046277:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974354688 00000100:00100000:0.0:1783137525.046299:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:0.0:1783137525.046305:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974354560:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137525.046341:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974354560:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 35us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137525.046347:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:0.0:1783137525.046358:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:0.0:1783137525.046364:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974354688:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137525.046385:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974354688:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 20us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137525.046390:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00080000:3.0:1783137525.046721:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137525.222957:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783137525.422331:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783137525.422339:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709b7c81800 from 7 10000000:01000000:2.0:1783137525.422344:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783137525.422391:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.422402:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.422413:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137525.422437:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.422513:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137525.422564:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098864f180 going to sleep for 11 seconds 00000100:00100000:1.0:1783137525.422922:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990118144 00000100:00100000:1.0:1783137525.422929:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990118144 00000100:00100000:1.0:1783137525.422977:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783137525.422986:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990118144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137525.422999:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137525.423010:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674a31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137525.423031:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674a31 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137525.423041:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674a31 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137525.423059:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d600, rc 0) 00000100:00100000:1.0:1783137525.423102:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990118144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137525.423109:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783137525.423339:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137525.423354:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.423363:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137525.423414:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.423440:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137525.423470:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098864f180 going to sleep for 11 seconds 00000100:00100000:1.0:1783137525.423987:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990118272 00000100:00100000:1.0:1783137525.423993:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990118272 00000100:00100000:1.0:1783137525.424028:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783137525.424035:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990118272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137525.424436:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990118272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137525.424444:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783137525.424516:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.424550:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.424588:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137525.424612:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098864f180 going to sleep for 11 seconds 00000100:00100000:0.0:1783137525.424651:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990118400 00000100:00100000:0.0:1783137525.424664:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990118400 00000100:00100000:0.0:1783137525.424695:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783137525.424703:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990118400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137525.424881:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990118400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137525.424895:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783137525.425095:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783137525.426117:0:11123:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783137525.426280:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783137525.426299:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783137525.426309:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.426320:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137525.426329:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783137525.426332:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709886eb800 from 7 10000000:01000000:2.0:1783137525.426334:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783137525.426361:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.426382:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.426391:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137525.426409:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.426452:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137525.426487:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade250c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137525.427367:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990118528 00000100:00100000:0.0:1783137525.427376:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990118528 00000100:00100000:0.0:1783137525.427422:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783137525.427431:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990118528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137525.427444:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137525.427458:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674a3f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137525.427493:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674a3f expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137525.427503:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674a3f expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137525.427512:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234200, rc 0) 00000100:00100000:0.0:1783137525.427561:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990118528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137525.427567:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1783137525.428782:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137525.428837:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.428847:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137525.428908:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.428951:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137525.428983:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade250c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137525.431954:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990118656 00000100:00100000:1.0:1783137525.431968:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990118656 00000100:00100000:1.0:1783137525.432020:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783137525.432030:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990118656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137525.432327:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990118656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (3374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137525.432335:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1783137525.432569:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.432618:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.432666:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137525.432698:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade250c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137525.432711:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990118784 00000100:00100000:2.0:1783137525.432715:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990118784 00000100:00100000:2.0:1783137525.432748:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783137525.432754:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990118784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.432925:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990118784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137525.432931:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783137525.432972:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783137525.434982:0:11124:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783137525.435191:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783137525.435223:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137525.435235:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137525.435269:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137525.435280:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783137525.435282:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97099cc6e000 from 7 10000000:01000000:1.0:1783137525.435285:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137525.435317:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137525.435324:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137525.435333:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137525.435355:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137525.435410:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137525.435449:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a24a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137525.435597:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990118912 00000100:00100000:2.0:1783137525.435603:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990118912 00000100:00100000:2.0:1783137525.435645:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783137525.435654:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990118912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137525.435674:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137525.435686:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674a4d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.435707:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674a4d expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.435717:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674a4d expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.435726:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050400, rc 0) 00000100:00100000:2.0:1783137525.435763:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990118912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137525.435769:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783137525.436564:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7957800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990118912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137525.436582:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137525.436602:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137525.436673:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990119040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137525.436707:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137525.436741:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098c162600 going to sleep for 11 seconds 00000100:00100000:1.0:1783137525.440673:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990119040 00000100:00100000:1.0:1783137525.440689:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990119040 00000100:00100000:1.0:1783137525.440745:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783137525.440755:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990119040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137525.441051:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990119040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (4341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137525.441059:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783137525.441113:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990119040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137525.441162:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7957100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990119168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137525.441222:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137525.441241:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a24e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137525.441253:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990119168 00000100:00100000:1.0:1783137525.441256:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990119168 00000100:00100000:1.0:1783137525.441276:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783137525.441281:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990119168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137525.441399:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990119168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137525.441406:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783137525.441477:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7957100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990119168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783137525.447628:0:11126:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783137525.448289:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783137525.448313:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137525.448325:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137525.448336:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137526.246987:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137527.271542:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137527.720598:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990119680:0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.720669:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137527.720716:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783137527.720722:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990119296:0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.720748:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137527.720769:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990119808:0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.720789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137527.720843:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990119424:0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.720864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137527.720881:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990119936:0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.720900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137527.720917:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137527.720922:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990119552:0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.720940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137527.720967:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990119680 00000100:00100000:0.0:1783137527.720974:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990119680 00000100:00100000:0.0:1783137527.721035:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990119936 00000100:00100000:0.0:1783137527.721038:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990119936 00000100:00100000:0.0:1783137527.721059:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783137527.721066:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990119680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.721115:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990119680:12345-0@lo:400:kworker.0 Request processed in 49us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137527.721121:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783137527.721136:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783137527.721142:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990119936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.721172:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990119936:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137527.721178:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783137527.721197:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990119296 00000100:00080000:3.0:1783137527.721198:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137527.721201:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990119296 00000100:00080000:3.0:1783137527.721204:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137527.721231:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783137527.721237:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990119296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.721266:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990119296:12345-0@lo:400:kworker.0 Request processed in 29us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137527.721282:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783137527.721309:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990119808 00000100:00100000:0.0:1783137527.721312:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990119808 00000100:00100000:0.0:1783137527.721349:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990119424 00000100:00100000:0.0:1783137527.721352:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990119424 00000100:00100000:0.0:1783137527.721362:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990119552 00000100:00100000:0.0:1783137527.721364:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990119552 00000100:00100000:0.0:1783137527.721377:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783137527.721382:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990119808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.721410:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990119808:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137527.721416:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783137527.721427:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783137527.721432:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990119424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.721467:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990119424:12345-0@lo:400:kworker.0 Request processed in 35us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137527.721473:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1783137527.721478:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137527.721486:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783137527.721493:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990119552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.721518:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990119552:12345-0@lo:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137527.721523:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783137527.721875:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990119552:0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.721887:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990119424:0@lo:400:kworker.0 00010000:00080000:0.0:1783137527.721899:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a80700 x1869754990119936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137527.721917:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990119936:0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.722136:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990119296:0@lo:400:kworker.0 00000100:00100000:0.0:1783137527.722147:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990119808:0@lo:400:kworker.0 00010000:00080000:0.0:1783137527.722158:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988a80380 x1869754990119680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137527.722167:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990119680:0@lo:400:kworker.0 00000001:02000400:3.0:1783137527.776479:0:11258:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783137528.231057:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990120064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137528.231135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137528.231266:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990120064 00000100:00100000:0.0:1783137528.231274:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990120064 00000100:00100000:0.0:1783137528.231326:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783137528.231336:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990120064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137528.231369:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137528.231421:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990120064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137528.231428:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1783137528.231992:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac2d80 x1869754990120064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137528.232012:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990120064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137528.295058:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137528.743250:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137528.743272:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990120192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137528.743339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137528.743550:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990120192 00000100:00100000:0.0:1783137528.743558:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990120192 00000100:00100000:0.0:1783137528.743607:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783137528.743616:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990120192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137528.743652:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137528.743717:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990120192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137528.743724:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1783137528.743863:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff970988ac3480 x1869754990120192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137528.743882:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990120192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783137529.335315:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137530.165561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137530.165617:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137530.165624:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974354944 00000100:00100000:3.0:1783137530.165634:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974354944 00000100:00100000:0.0:1783137530.165643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137530.165663:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974355072 00000100:00100000:0.0:1783137530.165666:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974355072 00000100:00100000:3.0:1783137530.165689:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:3.0:1783137530.165698:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974354944:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137530.165956:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974354944:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 258us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137530.172728:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:0.0:1783137530.172758:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974355072:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137530.172865:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974355072:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 122us (7220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137530.172872:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00080000:0.0:1783137530.173075:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137530.173092:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974354816 00000100:00100000:0.0:1783137530.173099:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974354816 00000100:00100000:0.0:1783137530.173136:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 246 00000100:00100000:0.0:1783137530.173143:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974354816:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137530.173177:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974354816:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 34us (7559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137530.173184:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 246 00000100:00100000:3.0:1783137530.176061:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 92 00010000:00010000:2.0:1783137530.343270:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137531.366922:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783137531.510700:0:11358:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:58:49 (1783137529) === 00000100:00100000:1.0:1783137531.754319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137531.754540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137531.754626:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974355200 00000100:00100000:0.0:1783137531.754636:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974355200 00000100:00100000:3.0:1783137531.754656:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974355328 00000100:00100000:3.0:1783137531.754661:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974355328 00000100:00100000:3.0:1783137531.754687:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:0.0:1783137531.754690:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1783137531.754697:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:9680:x1869754974355328:12345-192.168.203.36@tcp:700:mkdir.0 00000100:00100000:0.0:1783137531.754697:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2353:x1869754974355200:12345-192.168.203.36@tcp:41:mkdir.0 00000004:00000024:0.0:1783137531.754739:0:7113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783137531.754812:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:9680:x1869754974355328:12345-192.168.203.36@tcp:700:mkdir.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137531.754840:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:0.0:1783137531.760329:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974355200:12345-192.168.203.36@tcp:41:mkdir.0 Request processed in 5621us (6009us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137531.760344:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:0.0:1783137531.765889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137531.766735:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974355584 00000100:00100000:3.0:1783137531.766746:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974355584 00000100:00100000:3.0:1783137531.766834:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:3.0:1783137531.766844:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:9680:x1869754974355584:12345-192.168.203.36@tcp:36:mkdir.0 00010000:00010000:3.0:1783137531.766912:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137531.767146:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac67493c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726e8 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.767175:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51c00) 00010000:00010000:3.0:1783137531.767186:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137531.767609:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.767624:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.767633:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.767669:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.767678:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.767685:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137531.769668:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783137531.769684:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.769694:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.769702:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.769715:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137531.769719:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.769728:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.769743:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960f00) 00010000:00010000:3.0:1783137531.769747:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137531.769751:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.769757:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137531.769776:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dedc47b4 reply state 00000000dc33c473 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137531.769786:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137531.770412:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:9680:x1869754974355584:12345-192.168.203.36@tcp:36:mkdir.0 Request processed in 3565us (4527us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783137531.770429:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00010000:00010000:0.0:1783137531.772042:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.772059:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.772067:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.772074:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137531.772079:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.772087:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.772106:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff970987960d00) 00010000:00010000:0.0:1783137531.772110:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137531.772114:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.772121:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac674a62 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137531.786480:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137531.787441:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974355712 00000100:00100000:1.0:1783137531.787453:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974355712 00000100:00100000:1.0:1783137531.787529:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:1.0:1783137531.787540:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:9681:x1869754974355712:12345-192.168.203.36@tcp:101:chmod.0 00010000:00010000:1.0:1783137531.787558:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137531.787580:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674a69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7276d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.787643:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.787657:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.787668:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137531.787726:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783137531.787730:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137531.787766:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.787822:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674a69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7276d expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.787841:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7276d expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.787850:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51c00) 00010000:00010000:1.0:1783137531.787853:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137531.787856:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0de00, rc 0) 00000100:00100000:1.0:1783137531.787923:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:9681:x1869754974355712:12345-192.168.203.36@tcp:101:chmod.0 Request processed in 385us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137531.787936:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1783137531.790323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137531.790479:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974355968 00000100:00100000:1.0:1783137531.790488:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974355968 00000100:00100000:1.0:1783137531.790543:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:1.0:1783137531.790553:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:9681:x1869754974355968:12345-192.168.203.36@tcp:36:chmod.0 00010000:00010000:1.0:1783137531.790599:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137531.790623:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7276d expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.790639:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51c00) 00010000:00010000:1.0:1783137531.790649:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137531.790670:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.790680:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.790691:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137531.791647:0:5814:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca4c6897 reply state 00000000f68fe6a2 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137531.791661:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783137531.791677:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1783137531.791766:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:9681:x1869754974355968:12345-192.168.203.36@tcp:36:chmod.0 Request processed in 1212us (1449us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783137531.791773:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00010000:00010000:1.0:1783137531.798026:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.798045:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.798054:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.798060:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137531.798065:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.798073:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.798088:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51000) 00010000:00010000:1.0:1783137531.798091:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783137531.798095:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.798101:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a77 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137531.827456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137531.827618:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974356096 00000100:00100000:1.0:1783137531.827628:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974356096 00000100:00100000:1.0:1783137531.827683:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:1.0:1783137531.827694:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:9682:x1869754974356096:12345-192.168.203.36@tcp:101:chown.0 00010000:00010000:1.0:1783137531.827730:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137531.827751:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72774 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.827869:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.827882:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.827893:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137531.827951:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783137531.827955:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137531.827993:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.828022:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72774 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.828040:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72774 expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.828048:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51000) 00010000:00010000:1.0:1783137531.828051:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137531.828054:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0de00, rc 0) 00000100:00100000:1.0:1783137531.828112:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:9682:x1869754974356096:12345-192.168.203.36@tcp:101:chown.0 Request processed in 420us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137531.828119:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:2.0:1783137531.830164:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137531.830344:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974356224 00000100:00100000:3.0:1783137531.830352:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974356224 00000100:00100000:3.0:1783137531.830399:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1783137531.830409:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:9682:x1869754974356224:12345-192.168.203.36@tcp:101:chown.0 00010000:00010000:3.0:1783137531.830436:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137531.830467:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7277b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.830524:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.830537:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.830548:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.830562:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.830569:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.830576:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.830905:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674aa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.830914:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.830921:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137531.830960:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783137531.830964:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137531.830989:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831008:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831014:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831021:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831028:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137531.831031:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831038:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831049:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51000) 00010000:00010000:3.0:1783137531.831051:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137531.831055:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831060:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac674a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831070:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831076:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831081:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831090:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137531.831093:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831098:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831107:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff970987960f00) 00010000:00010000:3.0:1783137531.831110:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137531.831113:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831119:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674a9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831299:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674a8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7277b expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831316:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7277b expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.831322:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970987960200) 00010000:00010000:3.0:1783137531.831325:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137531.831327:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005e00, rc 0) 00000100:00100000:3.0:1783137531.831448:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:9682:x1869754974356224:12345-192.168.203.36@tcp:101:chown.0 Request processed in 1039us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137531.831456:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:2.0:1783137531.840688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137531.840843:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974356480 00000100:00100000:3.0:1783137531.840867:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974356480 00000100:00100000:3.0:1783137531.840924:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:3.0:1783137531.840935:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:9682:x1869754974356480:12345-192.168.203.36@tcp:36:chown.0 00010000:00010000:3.0:1783137531.840990:0:7113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137531.841018:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674aa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7277b expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.841038:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970987960200) 00010000:00010000:3.0:1783137531.841049:0:7113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137531.841072:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.841084:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.841094:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137531.930912:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb4f7c60 reply state 000000009789ff45 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137531.930931:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783137531.931087:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783137531.931206:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:9682:x1869754974356480:12345-192.168.203.36@tcp:36:chown.0 Request processed in 90270us (90523us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783137531.931215:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000001:00080000:2.0:1783137531.931428:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1783137531.931454:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1783137531.931511:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.931521:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.931537:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.931544:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137531.931548:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.931556:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.931571:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970987960100) 00010000:00010000:3.0:1783137531.931574:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783137531.931579:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.931584:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aa8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137531.954773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137531.954891:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974356608 00000100:00100000:1.0:1783137531.954901:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974356608 00000100:00100000:1.0:1783137531.954965:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:1.0:1783137531.954974:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:9683:x1869754974356608:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:1.0:1783137531.954998:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137531.955017:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674aaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72782 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137531.958486:0:5814:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3422us 00010000:00010000:2.0:1783137531.972666:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.972689:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.972702:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.972734:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.972741:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.972747:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973191:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051a00/0x88def104ac674ac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973200:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051a00/0x88def104ac674ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973208:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051a00/0x88def104ac674ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137531.973288:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783137531.973293:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137531.973538:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051a00/0x88def104ac674ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973551:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973558:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973565:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973582:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137531.973586:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973593:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973606:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51000) 00010000:00010000:2.0:1783137531.973608:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137531.973613:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973619:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973632:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973638:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973644:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973649:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137531.973652:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973658:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973675:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff970990e98500) 00010000:00010000:2.0:1783137531.973678:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137531.973681:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973687:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050000/0x88def104ac674abd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973723:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674aaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72782 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973738:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051a00/0x88def104ac674ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72782 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137531.973744:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137531.973746:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783137531.973749:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051a00, rc 0) 00000100:00100000:2.0:1783137531.976324:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:9683:x1869754974356608:12345-192.168.203.36@tcp:101:touch.500 Request processed in 21330us (21540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137531.976337:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:0.0:1783137531.982960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137531.983046:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974356864 00000100:00100000:1.0:1783137531.983055:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974356864 00000100:00100000:1.0:1783137531.983103:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:1.0:1783137531.983112:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:9683:x1869754974356864:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:1.0:1783137531.983131:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137531.983160:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674acb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72789 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.983643:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.983658:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.983671:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.983753:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.983761:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.983768:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783137531.985259:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1783137531.985703:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.985717:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.985727:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.985759:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.985766:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.985772:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.985779:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137531.985783:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.985937:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.985953:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970990e98b00) 00010000:00010000:1.0:1783137531.985956:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137531.985962:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.985980:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674ad2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137531.985994:0:5815:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc705d25 reply state 00000000114a5939 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137531.986003:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783137531.986038:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674acb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72789 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.986052:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72789 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.986059:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff970990e51e00) 00010000:00010000:1.0:1783137531.986061:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137531.986064:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c800, rc 0) 00000100:00100000:1.0:1783137531.986137:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:9683:x1869754974356864:12345-192.168.203.36@tcp:101:touch.500 Request processed in 3025us (3185us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783137531.986145:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00010000:00010000:0.0:1783137531.988512:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.988528:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.988548:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.988554:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0ce00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137531.988559:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.988566:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.988580:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3e0961b7 (ffff970990e51c00) 00010000:00010000:0.0:1783137531.988583:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137531.988587:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137531.988592:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674ad9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137531.992698:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137531.992949:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974357120 00000100:00100000:3.0:1783137531.992959:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974357120 00000100:00100000:3.0:1783137531.993014:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:3.0:1783137531.993025:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:9683:x1869754974357120:12345-192.168.203.36@tcp:36:touch.500 00010000:00010000:3.0:1783137531.993080:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137531.993104:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72789 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.993122:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff970990e51e00) 00010000:00010000:3.0:1783137531.993133:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137531.993180:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.993204:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.993214:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137531.993338:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6a78db7 reply state 00000000b438c53a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137531.993346:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137531.993446:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:9683:x1869754974357120:12345-192.168.203.36@tcp:36:touch.500 Request processed in 422us (757us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783137531.993454:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00010000:00010000:1.0:1783137531.995142:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.995168:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.995174:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.995181:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137531.995198:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.995207:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.995220:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137531.995223:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137531.995227:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137531.995234:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac674aee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137531.996226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137531.996506:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974357248 00000100:00100000:3.0:1783137531.996515:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974357248 00000100:00100000:3.0:1783137531.996563:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:3.0:1783137531.996573:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:9683:x1869754974357248:12345-192.168.203.36@tcp:101:touch.500 00010000:00010000:3.0:1783137531.996594:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137531.996613:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674af5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72790 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.996675:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674af5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72790 expref: 10 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.996688:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674af5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72790 expref: 10 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137531.996707:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff970987960f00) 00010000:00010000:3.0:1783137531.996719:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783137531.996722:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005e00, rc 0) 00000100:00100000:3.0:1783137531.996783:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:9683:x1869754974357248:12345-192.168.203.36@tcp:101:touch.500 Request processed in 210us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137531.996889:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:3.0:1783137532.000456:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137532.000529:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974357376 00000100:00100000:0.0:1783137532.000539:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974357376 00000100:00100000:0.0:1783137532.000586:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:0.0:1783137532.000595:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1869754974357376:12345-192.168.203.36@tcp:8:touch.500 00010000:00080000:0.0:1783137532.000622:0:6618:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:0.0:1783137532.000650:0:6618:0:(genops.c:1406:class_connect()) connect: client d717cef4-1367-4dd9-ae68-a0c1ee666834, cookie 0x88def104ac674afc 00002000:00100000:0.0:1783137532.000660:0:6618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d717cef4-1367-4dd9-ae68-a0c1ee666834/ffff9709b791c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783137532.000689:0:6618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783137532.000932:0:6618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783137532.000959:0:6618:0:(import.c:65:import_set_state_nolock()) ffff9709b791f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783137532.001017:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2350:x1869754974357376:12345-192.168.203.36@tcp:8:touch.500 Request processed in 422us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137532.001025:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:1.0:1783137532.005100:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137532.007789:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974357504 00000100:00100000:0.0:1783137532.007813:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974357504 00000100:00100000:0.0:1783137532.007904:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:0.0:1783137532.007915:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:0:x1869754974357504:12345-192.168.203.36@tcp:2:touch.500 00000100:00080000:3.0:1783137532.008274:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1783137532.059360:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1783137532.059377:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000100:00100000:3.0:1783137532.059571:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:0:x1869754974357504:12345-192.168.203.36@tcp:2:touch.500 Request processed in 51652us (54474us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783137532.059582:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:3.0:1783137532.066388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137532.066459:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974357760 00000100:00100000:2.0:1783137532.066469:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974357760 00000100:00080000:3.0:1783137532.066523:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137532.066549:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:2.0:1783137532.066562:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:9683:x1869754974357760:12345-192.168.203.36@tcp:35:touch.500 00000100:00100000:2.0:1783137532.066910:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:9683:x1869754974357760:12345-192.168.203.36@tcp:35:touch.500 Request processed in 351us (531us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783137532.066917:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:3.0:1783137532.087746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137532.087842:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974357888 00000100:00100000:0.0:1783137532.087852:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974357888 00000100:00100000:0.0:1783137532.087907:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:0.0:1783137532.087917:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:9684:x1869754974357888:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:0.0:1783137532.087944:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137532.087961:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac674b03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72797 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.088026:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674b0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.088040:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.088051:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137532.088106:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783137532.088122:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137532.088168:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.088193:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac674b03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72797 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.088223:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72797 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.088233:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137532.088236:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137532.088239:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234000, rc 0) 00000100:00100000:0.0:1783137532.088297:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+12:9684:x1869754974357888:12345-192.168.203.36@tcp:101:rm.0 Request processed in 382us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137532.088304:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:1.0:1783137532.094586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137532.094675:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974358144 00000100:00100000:3.0:1783137532.094685:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974358144 00000100:00100000:3.0:1783137532.094738:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:3.0:1783137532.094748:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+12:9684:x1869754974358144:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1783137532.094768:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137532.094786:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674b11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7279e expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137532.094940:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783137532.095128:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674b11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7279e expref: 14 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.095143:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51000) 00010000:00010000:3.0:1783137532.095163:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137532.095169:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674b11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7279e expref: 14 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.095182:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004200, rc 0) 00000100:00100000:3.0:1783137532.095241:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:9684:x1869754974358144:12345-192.168.203.36@tcp:101:rm.0 Request processed in 494us (664us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1783137532.095249:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:0.0:1783137532.098759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137532.098895:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974358272 00000100:00100000:2.0:1783137532.098904:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974358272 00000100:00100000:2.0:1783137532.098946:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:2.0:1783137532.098956:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:9684:x1869754974358272:12345-192.168.203.36@tcp:37:rm.0 00000100:00100000:2.0:1783137532.102337:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:9684:x1869754974358272:12345-192.168.203.36@tcp:37:rm.0 Request processed in 3373us (3577us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137532.102351:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:1.0:1783137532.105251:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137532.106865:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974358528 00000100:00100000:0.0:1783137532.106876:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974358528 00000100:00100000:1.0:1783137532.107322:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:1.0:1783137532.107333:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:9684:x1869754974358528:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:1.0:1783137532.108170:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:9684:x1869754974358528:12345-192.168.203.36@tcp:35:rm.0 Request processed in 834us (2923us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783137532.108181:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:0.0:1783137532.110764:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137532.110878:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974358784 00000100:00100000:3.0:1783137532.110887:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974358784 00000100:00100000:3.0:1783137532.110950:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:3.0:1783137532.110961:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:9684:x1869754974358784:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:3.0:1783137532.110983:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137532.111003:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674b1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.111124:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674b26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.111137:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674b26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.111149:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674b26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137532.111171:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783137532.111322:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674b1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727a5 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.111339:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674b26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727a5 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.111354:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970990e98b00) 00010000:00010000:3.0:1783137532.111357:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783137532.111360:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005400, rc 0) 00000100:00100000:3.0:1783137532.111407:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:9684:x1869754974358784:12345-192.168.203.36@tcp:101:rm.0 Request processed in 447us (651us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783137532.111422:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:0.0:1783137532.116309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137532.116395:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974358912 00000100:00100000:3.0:1783137532.116406:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974358912 00000100:00100000:3.0:1783137532.116506:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:3.0:1783137532.116517:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:9684:x1869754974358912:12345-192.168.203.36@tcp:41:rm.0 00000004:00000024:3.0:1783137532.116574:0:7113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1783137532.116649:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:9684:x1869754974358912:12345-192.168.203.36@tcp:41:rm.0 Request processed in 134us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137532.116657:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:1.0:1783137532.120693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137532.120770:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974359040 00000100:00100000:0.0:1783137532.120779:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974359040 00000100:00100000:0.0:1783137532.120849:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:0.0:1783137532.120858:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:9684:x1869754974359040:12345-192.168.203.36@tcp:101:rm.0 00010000:00010000:0.0:1783137532.120877:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137532.120895:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727ac expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.120984:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.120999:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121010:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121026:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121032:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121039:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121326:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674b49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121336:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121343:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137532.121369:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783137532.121373:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137532.121390:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121423:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121432:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121438:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121443:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121449:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137532.121453:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121461:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121471:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137532.121474:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137532.121478:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121485:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121496:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121502:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121514:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121520:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137532.121522:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121530:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121538:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3e0961b7 (ffff9709860f4b00) 00010000:00010000:0.0:1783137532.121540:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137532.121543:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121549:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121580:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727ac expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121593:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674b49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727ac expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.121599:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff970987960f00) 00010000:00010000:0.0:1783137532.121601:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137532.121604:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235200, rc 0) 00000100:00100000:0.0:1783137532.121665:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:9684:x1869754974359040:12345-192.168.203.36@tcp:101:rm.0 Request processed in 807us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137532.121681:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:0.0:1783137532.124994:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137532.125088:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974359296 00000100:00100000:1.0:1783137532.125230:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974359296 00000100:00100000:1.0:1783137532.125320:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:1.0:1783137532.125331:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:9684:x1869754974359296:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:1.0:1783137532.125385:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783137532.125410:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674b49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727ac expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125450:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac674af5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72790 expref: 16 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125461:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff970987960f00) 00010000:00010000:1.0:1783137532.125476:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674b0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72797 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125484:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970990e98b00) 00010000:00010000:1.0:1783137532.125487:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137532.125504:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125515:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125524:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125539:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125545:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125550:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125701:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125719:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.125726:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783137532.126626:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1783137532.126638:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288023845506ns, next at 289023843072ns, rc = 0 00010000:00010000:1.0:1783137532.126701:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.126712:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.126719:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.126726:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.126732:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.126738:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.126766:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137532.126784:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127025:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127040:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127045:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0cc00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137532.127049:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127056:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127068:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff970990e51300) 00010000:00010000:1.0:1783137532.127070:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783137532.127074:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127080:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674b5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127095:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.127204:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137532.127212:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.127218:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137532.127222:0:11060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.127228:0:11060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.127237:0:11060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff970990e51300) 00010000:00010000:2.0:1783137532.127239:0:11060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783137532.127242:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.127247:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d400/0x88def104ac674b65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.127260:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137532.127262:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137532.127263:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137532.127347:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127353:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127358:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137532.127361:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127377:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127386:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970990e98b00) 00010000:00010000:1.0:1783137532.127388:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137532.127392:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137532.127397:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac674b50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137532.127407:0:5815:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000601706cb reply state 000000000bb68a51 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137532.127424:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783137532.127514:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:9684:x1869754974359296:12345-192.168.203.36@tcp:36:rm.0 Request processed in 2181us (2525us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783137532.127523:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:2.0:1783137532.134680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137532.134711:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974359552 00000100:00100000:2.0:1783137532.134733:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974359552 00000100:00100000:2.0:1783137532.134782:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:2.0:1783137532.134808:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:9684:x1869754974359552:12345-192.168.203.36@tcp:35:rm.0 00000100:00100000:2.0:1783137532.135369:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:9684:x1869754974359552:12345-192.168.203.36@tcp:35:rm.0 Request processed in 576us (695us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783137532.135378:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00010000:00010000:3.0:1783137532.135516:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.135527:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.135535:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.135541:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0ca00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137532.135545:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.135567:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.135582:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3e0961b7 (ffff970990e51600) 00010000:00010000:3.0:1783137532.135585:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137532.135590:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137532.135596:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ca00/0x88def104ac674b57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137532.138064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137532.138171:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974359808 00000100:00100000:0.0:1783137532.138184:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974359808 00000100:00100000:0.0:1783137532.138280:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:0.0:1783137532.138291:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:9684:x1869754974359808:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:0.0:1783137532.138346:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783137532.138369:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac674b26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727a5 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138389:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051a00/0x88def104ac674ac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72782 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138400:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137532.138425:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0de00/0x88def104ac674a85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72774 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138436:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e51000) 00010000:00010000:0.0:1783137532.138444:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137532.138466:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138478:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138487:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138517:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138524:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138530:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138878:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138899:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.138907:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137532.139568:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783137532.139588:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139595:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139601:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139607:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137532.139611:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139629:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139640:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9709860f4900) 00010000:00010000:0.0:1783137532.139642:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783137532.139646:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139652:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674b7a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139672:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139677:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139682:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139686:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137532.139688:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139693:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139700:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4b00) 00010000:00010000:0.0:1783137532.139701:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137532.139704:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137532.139718:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674b6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137532.139730:0:5814:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f92e7f5 reply state 00000000724b79e2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137532.139739:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137532.139869:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:9684:x1869754974359808:12345-192.168.203.36@tcp:36:rm.0 Request processed in 1577us (1811us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783137532.139878:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00010000:00010000:2.0:1783137532.145065:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.145083:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.145090:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.145096:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137532.145101:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.145110:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.145126:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9709860f4600) 00010000:00010000:2.0:1783137532.145129:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137532.145134:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.145140:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674b73 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137532.395438:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137532.840460:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990120704:0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.840528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137532.840578:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783137532.840585:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990120320:0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.840612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137532.840631:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990120832:0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.840664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137532.840690:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990120448:0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.840712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137532.840739:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990120960:0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.840768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137532.840786:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137532.840809:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990120576:0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.840830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137532.840862:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990120832 00000100:00100000:1.0:1783137532.840869:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990120832 00000100:00100000:1.0:1783137532.840925:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990120448 00000100:00100000:1.0:1783137532.840929:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990120448 00000100:00100000:1.0:1783137532.840941:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990120576 00000100:00100000:1.0:1783137532.840943:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990120576 00000100:00100000:1.0:1783137532.840959:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783137532.840966:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990120832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.841016:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990120832:12345-0@lo:400:kworker.0 Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137532.841024:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783137532.841039:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783137532.841045:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.841078:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990120448:12345-0@lo:400:kworker.0 Request processed in 33us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137532.841084:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783137532.841096:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783137532.841102:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990120576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.841127:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990120576:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137532.841133:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783137532.841152:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990120704 00000100:00100000:1.0:1783137532.841162:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990120704 00000100:00100000:1.0:1783137532.841189:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990120960 00000100:00100000:1.0:1783137532.841191:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990120960 00000100:00100000:1.0:1783137532.841211:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783137532.841216:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990120704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.841247:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990120704:12345-0@lo:400:kworker.0 Request processed in 30us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137532.841252:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783137532.841263:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783137532.841269:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990120960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.841296:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990120960:12345-0@lo:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137532.841301:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1783137532.841319:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137532.841322:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137532.841325:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137532.841366:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990120576:0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.841376:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990120448:0@lo:400:kworker.0 00010000:00080000:1.0:1783137532.841385:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd075c00 x1869754990120960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137532.841396:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990120960:0@lo:400:kworker.0 00000100:00100000:1.0:1783137532.841434:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990120832:0@lo:400:kworker.0 00010000:00080000:1.0:1783137532.841445:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd077480 x1869754990120704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137532.841453:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990120704:0@lo:400:kworker.0 00000100:00100000:0.0:1783137532.843439:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990120320 00000100:00100000:0.0:1783137532.843451:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990120320 00000100:00100000:0.0:1783137532.843497:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783137532.843506:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990120320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137532.843580:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990120320:12345-0@lo:400:kworker.0 Request processed in 75us (2966us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137532.843587:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783137532.843659:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990120320:0@lo:400:kworker.0 00000100:00100000:1.0:1783137533.352698:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990121088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137533.352764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137533.355286:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990121088 00000100:00100000:2.0:1783137533.355300:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990121088 00000100:00100000:0.0:1783137533.356363:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137533.356375:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990121088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137533.356422:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137533.356682:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990121088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 307us (3915us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137533.356690:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1783137533.356742:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709897df480 x1869754990121088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137533.356786:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990121088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137533.436439:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137533.870830:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990121216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137533.870969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137533.871109:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990121216 00000100:00100000:3.0:1783137533.871117:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990121216 00000100:00100000:3.0:1783137533.871175:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783137533.871185:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990121216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137533.871222:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000004:00080000:1.0:1783137533.871328:0:6667:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289768535361ns, next at 290768533015ns, rc = 0 00000100:00100000:3.0:1783137533.872212:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990121216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1025us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137533.872222:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1783137533.872707:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd076680 x1869754990121216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137533.872729:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990121216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137534.441151:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137535.288897:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137535.288934:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137535.288968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137535.288998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137535.289053:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974359936 00000100:00100000:0.0:1783137535.289063:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974359936 00000100:00100000:0.0:1783137535.289113:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 248 00000100:00100000:0.0:1783137535.289130:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974359936:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137535.289195:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974359936:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137535.289203:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 248 00000100:00100000:1.0:1783137535.289508:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974360064 00000100:00100000:1.0:1783137535.289513:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974360064 00000100:00100000:1.0:1783137535.289560:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974360320 00000100:00100000:1.0:1783137535.289563:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974360320 00000100:00100000:1.0:1783137535.289586:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:1.0:1783137535.289593:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:2351:x1869754974360064:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137535.289635:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:2351:x1869754974360064:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 42us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137535.289642:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:1.0:1783137535.289655:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:1.0:1783137535.289661:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974360320:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137535.289686:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974360320:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 25us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137535.289692:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:1.0:1783137535.289709:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974360192 00000100:00100000:1.0:1783137535.289712:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974360192 00000100:00100000:1.0:1783137535.289736:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:1.0:1783137535.289742:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974360192:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137535.289766:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974360192:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 24us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137535.289771:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00080000:0.0:1783137535.290055:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137535.290060:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137535.463107:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783137536.449451:0:11511:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1783137536.488547:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783137536.996820:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1783137536.996839:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:0.0:1783137536.996854:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1783137536.997076:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990121344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783137536.997156:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137536.997342:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990121344 00000100:00100000:3.0:1783137536.997351:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990121344 00000100:00100000:3.0:1783137536.997425:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783137536.997435:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990121344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783137536.997461:0:6620:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1783137536.997490:0:6620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a4884fb, atime: 0x6a4884fb, ctime: 0x6a4884fb, blocks: 0x1 00010000:00010000:3.0:1783137536.997498:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137536.997532:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=292s v=(0 0) 00010000:00010000:3.0:1783137536.997536:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137536.997542:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137536.997558:0:6620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137536.997568:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137536.997576:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137536.997592:0:6620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1783137536.998204:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137537.000695:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990121344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3253us (3530us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783137537.000709:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1783137537.002263:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709bd075c00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1783137537.002275:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990121344:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783137537.002313:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137537.002320:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.002332:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137537.002337:0:11060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.002348:0:11060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.002369:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.002377:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac674b81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.002420:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137537.002423:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137537.002425:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137537.513471:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783137537.525516:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:2.0:1783137537.556033:0:11561:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd8084560 20000000:00000080:2.0:1783137537.556049:0:11561:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9709bd00d000 uarg=0000000000000000 20000000:01000000:2.0:1783137537.556083:0:11561:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1783137537.556089:0:11561:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1783137537.556093:0:11561:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1783137537.557040:0:11562:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1783137537.557197:0:11561:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1783137537.561729:0:11561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1783137537.561880:0:11561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1783137537.561946:0:11561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1783137537.561963:0:11561:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783137537.561983:0:11561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562004:0:11561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7275f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562012:0:11561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72766 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562032:0:11561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674a31 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562038:0:11561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674a3f expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562044:0:11561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674a4d expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562051:0:11561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562088:0:11561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac674a4d expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562102:0:11561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac674a4d expref: 18 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137537.562128:0:11561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121472:0@lo:104: 00000100:00100000:2.0:1783137537.562185:0:11561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137537.562236:0:11561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac674a3f expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562244:0:11561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac674a3f expref: 18 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137537.562253:0:11561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121600:0@lo:104: 00000100:00100000:2.0:1783137537.562271:0:11561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137537.562299:0:11561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac674a31 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562313:0:11561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac674a31 expref: 18 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137537.562322:0:11561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121728:0@lo:104: 00000100:00100000:2.0:1783137537.562348:0:11561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783137537.562366:0:11561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72766 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562389:0:11561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72766 expref: 12 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137537.562399:0:11561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121856:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137537.562454:0:11561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7275f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.562462:0:11561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7275f expref: 12 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137537.562470:0:11561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121984:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137537.562491:0:11561:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137537.562630:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783137537.562643:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990121472 00000100:00100000:3.0:1783137537.562650:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990121472 00000100:00100000:3.0:1783137537.562681:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990121600 00000100:00100000:3.0:1783137537.562684:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990121600 00000100:00100000:3.0:1783137537.562695:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990121728 00000100:00100000:3.0:1783137537.562698:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990121728 00000100:00100000:3.0:1783137537.562710:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783137537.562719:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+5:11561:x1869754990121472:12345-0@lo:104: 00010000:00010000:3.0:1783137537.562737:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.562820:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137537.562826:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+5:11561:x1869754990121472:12345-0@lo:104: Request processed in 109us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137537.562832:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783137537.562849:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783137537.562854:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:11561:x1869754990121600:12345-0@lo:104: 00010000:00010000:3.0:1783137537.562862:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.562889:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783137537.562894:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+4:11561:x1869754990121600:12345-0@lo:104: Request processed in 40us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137537.562899:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783137537.562908:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783137537.562913:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:11561:x1869754990121728:12345-0@lo:104: 00010000:00010000:3.0:1783137537.562920:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.562943:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783137537.562947:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73e4795b-54a4-4490-bb2a-864b21234c99+3:11561:x1869754990121728:12345-0@lo:104: Request processed in 34us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137537.562952:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1783137537.563049:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783137537.563055:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.563062:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d800 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137537.563066:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.563083:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137537.563090:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137537.563096:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783137537.563264:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137537.563269:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.563276:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137537.563278:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.563295:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137537.563301:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137537.563316:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1783137537.563486:0:11561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121472:0@lo:104: 00000100:00100000:3.0:1783137537.563499:0:11561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121600:0@lo:104: 00000100:00100000:3.0:1783137537.563518:0:11561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121728:0@lo:104: 00010000:00010000:0.0:1783137537.564475:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.564485:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137537.564517:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.564525:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac674a4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674a54 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.564545:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137537.564549:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.564555:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051e00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137537.564558:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.564566:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137537.564572:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.564770:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.564778:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137537.564785:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.564805:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd051400/0x88def104ac674a3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674a46 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.564816:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137537.564818:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137537.564820:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137537.564869:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990122112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137537.564924:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137537.564976:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137537.564982:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990122240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137537.565015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1783137537.565179:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783137537.565205:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.565210:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137537.565225:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.565231:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd051e00/0x88def104ac674a31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac674a38 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137537.565234:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990122112 00000100:00100000:3.0:1783137537.565241:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990122112 00010000:00010000:0.0:1783137537.565243:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137537.565244:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137537.565246:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137537.565252:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137537.565266:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674a4d expref: 19 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137537.565288:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990122240 00000100:00100000:3.0:1783137537.565291:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990122240 00010000:00010000:3.0:1783137537.565301:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674a3f expref: 20 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137537.565318:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783137537.565325:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+20:3306:x1869754990122112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137537.565336:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137537.565341:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674a4d expref: 20 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.565352:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac674a4d expref: 20 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.565365:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd050400/0x88def104ac674a54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac674a4d expref: 20 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.565385:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137537.565419:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990122112:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137537.565427:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783137537.565432:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137537.565440:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+18:3306:x1869754990122240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137537.565449:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137537.565454:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674a3f expref: 18 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.565463:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac674a3f expref: 18 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.565485:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd234200/0x88def104ac674a46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac674a3f expref: 18 pid: 5808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137537.565494:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137537.565521:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+17:3306:x1869754990122240:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137537.565527:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137537.565547:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990122368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137537.565572:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137537.565608:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990122368 00000100:00100000:3.0:1783137537.565612:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990122368 00010000:00010000:3.0:1783137537.565626:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674a31 expref: 17 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137537.565656:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783137537.565662:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+17:3308:x1869754990122368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137537.565670:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137537.565674:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac674a31 expref: 17 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.565683:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac674a31 expref: 17 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.565693:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709afd0d600/0x88def104ac674a38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac674a31 expref: 17 pid: 5807 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.565701:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137537.565726:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+16:3308:x1869754990122368:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137537.565730:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990122240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137537.565732:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783137537.565738:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990122112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137537.566000:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990122368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137537.567028:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137537.567092:0:11561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121856:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137537.567255:0:11561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11561:1869754990121984:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137537.567287:0:11561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137537.567462:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974360448 00000100:00100000:0.0:1783137537.567469:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974360448 00010000:00010000:0.0:1783137537.567498:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72766 expref: 13 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137537.567530:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:0.0:1783137537.567538:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974360448:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137537.567550:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137537.567556:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72766 expref: 13 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.567566:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72766 expref: 13 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.567608:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd004e00/0x88def104ac674a2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72766 expref: 13 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.567620:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137537.567681:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:2352:x1869754974360448:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 143us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137537.567688:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:2.0:1783137537.568486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137537.568898:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974360576 00000100:00100000:3.0:1783137537.568905:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974360576 00010000:00010000:3.0:1783137537.568930:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7275f expref: 12 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137537.568961:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:3.0:1783137537.568980:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:2353:x1869754974360576:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137537.568991:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137537.568996:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7275f expref: 12 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569005:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7275f expref: 12 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569019:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd235e00/0x88def104ac674a23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7275f expref: 12 pid: 5809 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569032:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569040:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569055:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569062:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569069:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569075:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569081:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137537.569085:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569113:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569134:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137537.569144:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137537.569187:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:2353:x1869754974360576:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 208us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137537.569194:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00010000:00010000:0.0:1783137537.569337:0:11561:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.569354:0:11561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137537.569360:0:11561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd051600/0x88def104ac674b88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137537.959854:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990122496:0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.959923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137537.959974:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990123008:0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.959998:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137537.960023:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137537.960027:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990122880:0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.960049:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137537.960071:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990122752:0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.960090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137537.960105:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137537.960110:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990122624:0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.960166:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137537.960195:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990122496 00000100:00100000:0.0:1783137537.960202:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990122496 00000100:00100000:0.0:1783137537.960235:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990122880 00000100:00100000:0.0:1783137537.960237:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990122880 00000100:00100000:0.0:1783137537.960255:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990122624 00000100:00100000:0.0:1783137537.960258:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990122624 00000100:00100000:0.0:1783137537.960274:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783137537.960281:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990122496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.960332:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990122496:12345-0@lo:400:kworker.0 Request processed in 51us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137537.960340:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783137537.960354:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783137537.960360:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990122880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.960402:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990122880:12345-0@lo:400:kworker.0 Request processed in 42us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137537.960408:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783137537.960418:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783137537.960424:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990122624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.960454:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990122624:12345-0@lo:400:kworker.0 Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137537.960460:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783137537.960491:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990122624:0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.960518:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990122880:0@lo:400:kworker.0 00000100:00100000:0.0:1783137537.960527:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990122496:0@lo:400:kworker.0 00000100:00080000:2.0:1783137537.961029:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137537.961256:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990123008 00000100:00100000:1.0:1783137537.961263:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990123008 00000100:00100000:1.0:1783137537.961308:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990122752 00000100:00100000:1.0:1783137537.961312:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990122752 00000100:00100000:1.0:1783137537.961329:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137537.961337:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990123008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137537.961401:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990123008:12345-0@lo:400:kworker.0 Request processed in 65us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137537.961407:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137537.961419:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137537.961425:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990122752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137537.961457:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990122752:12345-0@lo:400:kworker.0 Request processed in 33us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137537.961462:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137537.961499:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1783137537.961504:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709bd075c00, transno 4294967300 00000100:00100000:1.0:1783137537.961515:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990122752:0@lo:400:kworker.0 00000100:00080000:2.0:1783137537.961858:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783137537.961895:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bca7d880 x1869754990123008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137537.961905:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990123008:0@lo:400:kworker.0 00000100:00100000:1.0:1783137538.471148:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137538.471235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137538.471352:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990123136 00000100:00100000:0.0:1783137538.471360:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990123136 00000100:00100000:0.0:1783137538.471420:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783137538.471429:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990123136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137538.471464:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137538.471521:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990123136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137538.471529:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1783137538.472024:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709897dd180 x1869754990123136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137538.472043:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990123136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137538.535481:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137538.984941:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990123264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137538.985010:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137538.985776:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990123264 00000100:00100000:0.0:1783137538.985785:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990123264 00000100:00100000:0.0:1783137538.985876:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783137538.985886:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990123264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137538.985921:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137538.986003:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990123264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137538.986011:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783137538.986084:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990123264:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783137538.986152:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137539.255325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137539.255427:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974360704 00000100:00100000:0.0:1783137539.255436:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974360704 00000100:00100000:0.0:1783137539.255493:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 249 00000100:00100000:0.0:1783137539.255502:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:5571:x1869754974360704:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137539.255519:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137539.255537:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd234400/0x88def104ac674b8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727b3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137539.255566:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd234400/0x88def104ac674b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727b3 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137539.255593:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd234400/0x88def104ac674b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727b3 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137539.255602:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234400, rc 0) 00000100:00100000:0.0:1783137539.255658:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974360704:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 156us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137539.255665:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 249 00000100:00100000:2.0:1783137539.259726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137539.260345:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974360832 00000100:00100000:0.0:1783137539.260355:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974360832 00000100:00100000:0.0:1783137539.260425:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 250 00000100:00100000:0.0:1783137539.260435:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974360832:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137539.260720:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974360832:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 285us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137539.260728:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 250 00000100:00100000:1.0:1783137539.264876:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137539.264969:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974360960 00000100:00100000:2.0:1783137539.264978:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974360960 00000100:00100000:2.0:1783137539.265045:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 251 00000100:00100000:2.0:1783137539.265056:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974360960:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137539.265282:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974360960:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 227us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137539.265290:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 251 00000100:00100000:1.0:1783137539.274105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137539.274247:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974361088 00000100:00100000:0.0:1783137539.274257:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974361088 00000100:00100000:0.0:1783137539.274312:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 252 00000100:00100000:0.0:1783137539.274321:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:9955:x1869754974361088:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137539.274551:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:9955:x1869754974361088:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 231us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137539.274568:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 252 00000100:00100000:1.0:1783137539.278851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137539.278942:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974361216 00000100:00100000:0.0:1783137539.278952:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974361216 00000100:00100000:0.0:1783137539.279010:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 253 00000100:00100000:0.0:1783137539.279028:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:9955:x1869754974361216:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137539.279277:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:9955:x1869754974361216:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 258us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137539.279285:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 253 00000100:00100000:1.0:1783137539.287422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137539.287849:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974361344 00000100:00100000:2.0:1783137539.287859:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974361344 00000100:00100000:2.0:1783137539.287915:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 254 00000100:00100000:2.0:1783137539.287925:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:5571:x1869754974361344:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137539.287943:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137539.287959:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd050000/0x88def104ac674b96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727ba expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137539.287988:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd050000/0x88def104ac674b96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727ba expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137539.287999:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd050000/0x88def104ac674b96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727ba expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137539.288009:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050000, rc 0) 00000100:00100000:2.0:1783137539.288196:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974361344:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 271us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137539.288203:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 254 00000100:00100000:1.0:1783137539.292110:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137539.292259:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974361472 00000100:00100000:2.0:1783137539.292269:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974361472 00000100:00100000:2.0:1783137539.292325:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 255 00000100:00100000:2.0:1783137539.292335:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974361472:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137539.292787:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974361472:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 452us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137539.292965:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 255 00000100:00100000:1.0:1783137539.298221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137539.298356:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974361600 00000100:00100000:0.0:1783137539.298374:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974361600 00000100:00100000:0.0:1783137539.298431:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 256 00000100:00100000:0.0:1783137539.298450:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974361600:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137539.300467:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:5571:x1869754974361600:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 2009us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137539.300481:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 256 00000100:00100000:1.0:1783137539.306917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137539.307137:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974361728 00000100:00100000:0.0:1783137539.307145:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974361728 00000100:00100000:0.0:1783137539.307192:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 257 00000100:00100000:0.0:1783137539.307202:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:9958:x1869754974361728:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137539.307425:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:9958:x1869754974361728:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 224us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137539.307432:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 257 00000100:00100000:1.0:1783137539.311193:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137539.311286:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974361856 00000100:00100000:0.0:1783137539.311295:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974361856 00000100:00100000:0.0:1783137539.311404:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 258 00000100:00100000:0.0:1783137539.311415:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:9958:x1869754974361856:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137539.311824:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:9958:x1869754974361856:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 409us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137539.311833:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 258 10000000:01000000:1.0:1783137539.366905:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783137539.366913:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709b7c81800 from 7 10000000:01000000:1.0:1783137539.366918:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137539.366969:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.366981:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.366992:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137539.367016:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990123392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.367081:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137539.367286:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990123392 00000100:00100000:2.0:1783137539.367294:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990123392 00000100:00100000:2.0:1783137539.367350:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783137539.367370:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+16:5811:x1869754990123392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137539.367384:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137539.367398:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd051a00/0x88def104ac674ba4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674b9d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137539.367421:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd051a00/0x88def104ac674ba4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674b9d expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137539.367431:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd051a00/0x88def104ac674ba4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674b9d expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137539.367440:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051a00, rc 0) 00000100:00100000:2.0:1783137539.367476:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990123392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137539.367483:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783137539.369357:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137539.369415:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990123392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137539.369438:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.369449:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137539.369535:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990123520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.369592:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137539.369695:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990123520 00000100:00100000:2.0:1783137539.369702:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990123520 00000100:00100000:2.0:1783137539.369739:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783137539.369747:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709873b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990123520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783137539.370002:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709873b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990123520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137539.370010:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783137539.378258:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137539.378301:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990123520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.378359:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990123648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.378454:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137539.379190:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137539.379260:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990123648 00000100:00100000:2.0:1783137539.379275:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990123648 00000100:00100000:2.0:1783137539.379369:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1783137539.379378:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990123648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783137539.379594:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990123648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137539.379602:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1783137539.379679:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990123648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.382665:0:11574:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11574:1869754990123776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137539.382744:0:11574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137539.382808:0:11574:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7780 going to sleep for 11 seconds 00000100:00100000:3.0:1783137539.386300:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990123776 00000100:00100000:3.0:1783137539.386313:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990123776 00000100:00100000:3.0:1783137539.386386:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783137539.386397:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:11574:x1869754990123776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137539.386662:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+17:11574:x1869754990123776:12345-0@lo:502:llog_process_th.0 Request processed in 266us (3916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137539.386670:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1783137539.386855:0:11574:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11574:1869754990123776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137539.386888:0:11574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137539.386897:0:11574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137539.386899:0:11574:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783137539.386906:0:11574:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9709b7c81800 00000020:00000080:1.0:1783137539.386909:0:11574:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783137539.386988:0:11574:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11574:1869754990123904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137539.387039:0:11574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137539.387070:0:11574:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098c0df6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137539.387187:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990123904 00000100:00100000:0.0:1783137539.387191:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990123904 00000100:00100000:0.0:1783137539.387211:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783137539.387217:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:11574:x1869754990123904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137539.387346:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:11574:x1869754990123904:12345-0@lo:502:llog_process_th.0 Request processed in 128us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137539.387354:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783137539.387559:0:11574:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11574:1869754990123904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137539.387589:0:11574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137539.387594:0:11574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137539.387596:0:11574:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783137539.387600:0:11574:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1783137539.388236:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1783137539.388257:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137539.388268:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137539.388279:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137539.388293:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783137539.388296:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709886eb800 from 7 10000000:01000000:0.0:1783137539.388298:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783137539.388323:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137539.388332:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137539.388341:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137539.388358:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783137539.388408:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137539.388454:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a0b3ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137539.388883:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990124032 00000100:00100000:1.0:1783137539.388890:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990124032 00000100:00100000:1.0:1783137539.388926:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783137539.388934:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+17:5811:x1869754990124032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137539.388945:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137539.388957:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0c400/0x88def104ac674bb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674bab expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.388979:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0c400/0x88def104ac674bb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674bab expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.388989:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0c400/0x88def104ac674bb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674bab expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.388997:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c400, rc 0) 00000100:00100000:1.0:1783137539.389042:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990124032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137539.389049:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783137539.389133:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137539.389147:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137539.389156:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137539.389204:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137539.389230:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137539.389262:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a0b3ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137539.389373:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990124160 00000100:00100000:1.0:1783137539.389377:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990124160 00000100:00100000:1.0:1783137539.389409:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783137539.389416:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990124160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.389730:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990124160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137539.389737:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783137539.389769:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.389822:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.389859:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137539.389873:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098c162900 going to sleep for 11 seconds 00000100:00100000:1.0:1783137539.389885:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990124288 00000100:00100000:1.0:1783137539.389889:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990124288 00000100:00100000:1.0:1783137539.389907:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783137539.389912:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990124288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.390027:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990124288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137539.390033:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783137539.390062:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137539.396886:0:11575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11575:1869754990124416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137539.396969:0:11575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137539.397013:0:11575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a0b3ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137539.397108:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990124416 00000100:00100000:1.0:1783137539.397115:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990124416 00000100:00100000:1.0:1783137539.397159:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783137539.397168:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:11575:x1869754990124416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137539.397357:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:11575:x1869754990124416:12345-0@lo:502:llog_process_th.0 Request processed in 189us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137539.397388:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783137539.397709:0:11575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11575:1869754990124416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137539.397737:0:11575:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137539.397746:0:11575:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137539.397748:0:11575:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783137539.397754:0:11575:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9709886eb800 00000020:00000080:0.0:1783137539.397757:0:11575:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783137539.397851:0:11575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11575:1869754990124544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137539.397883:0:11575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137539.397907:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990124544 00000100:00100000:0.0:1783137539.397911:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990124544 00000100:00100000:0.0:1783137539.397933:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783137539.397939:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:11575:x1869754990124544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137539.398055:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+18:11575:x1869754990124544:12345-0@lo:502:llog_process_th.0 Request processed in 115us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137539.398067:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783137539.398163:0:11575:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a249c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137539.398176:0:11575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11575:1869754990124544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783137539.398195:0:11575:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137539.398200:0:11575:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137539.398201:0:11575:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783137539.398204:0:11575:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783137539.398426:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783137539.398444:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137539.398455:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.398470:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137539.398480:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783137539.398482:0:5811:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97099cc6e000 from 7 10000000:01000000:1.0:1783137539.398485:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137539.398521:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.398529:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.398538:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137539.398552:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783137539.398587:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137539.398614:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098c162c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137539.398952:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990124672 00000100:00100000:1.0:1783137539.398957:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990124672 00000100:00100000:1.0:1783137539.398987:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1783137539.398995:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+18:5811:x1869754990124672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137539.399005:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137539.399015:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0ca00/0x88def104ac674bc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac674bb9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.399037:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0ca00/0x88def104ac674bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac674bb9 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.399060:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0ca00/0x88def104ac674bc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac674bb9 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137539.399068:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0ca00, rc 0) 00000100:00100000:0.0:1783137539.399479:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137539.399506:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137539.399515:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137539.399565:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137539.399604:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137539.399633:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137539.399715:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990124800 00000100:00100000:3.0:1783137539.399720:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990124800 00000100:00100000:3.0:1783137539.399751:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783137539.399758:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+20:5811:x1869754990124800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137539.400012:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+20:5811:x1869754990124800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137539.400019:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783137539.400057:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137539.400091:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137539.400140:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137539.400158:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adefa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137539.400170:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990124928 00000100:00100000:3.0:1783137539.400173:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990124928 00000100:00100000:3.0:1783137539.400190:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1783137539.400195:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+20:5811:x1869754990124928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137539.400313:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+20:5811:x1869754990124928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137539.400319:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1783137539.400351:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73e4795b-54a4-4490-bb2a-864b21234c99:5811:1869754990124928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137539.400540:0:11578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11578:1869754990125056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137539.400571:0:11578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137539.400598:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990125056 00000100:00100000:3.0:1783137539.400601:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990125056 00000100:00100000:3.0:1783137539.400618:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783137539.400623:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+20:11578:x1869754990125056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137539.400733:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+20:11578:x1869754990125056:12345-0@lo:502:llog_process_th.0 Request processed in 109us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137539.400740:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783137539.400766:0:11578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a0f056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137539.400779:0:11578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11578:1869754990125056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783137539.400817:0:11578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137539.400825:0:11578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137539.400831:0:11578:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783137539.400838:0:11578:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97099cc6e000 00000020:00000080:3.0:1783137539.400841:0:11578:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783137539.400900:0:11578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11578:1869754990125184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137539.400932:0:11578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137539.400949:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990125184 00000100:00100000:3.0:1783137539.400952:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990125184 00000100:00100000:3.0:1783137539.400969:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783137539.400974:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+20:11578:x1869754990125184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137539.401072:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+20:11578:x1869754990125184:12345-0@lo:502:llog_process_th.0 Request processed in 97us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137539.401079:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783137539.401109:0:11578:0:(client.c:2701:ptlrpc_set_wait()) set ffff970989b99540 going to sleep for 11 seconds 00000100:00100000:3.0:1783137539.401121:0:11578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73e4795b-54a4-4490-bb2a-864b21234c99:11578:1869754990125184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783137539.401138:0:11578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137539.401141:0:11578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137539.401143:0:11578:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783137539.401146:0:11578:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783137539.401184:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783137539.401202:0:5811:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783137539.401210:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137539.401219:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137539.404018:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:5811:x1869754990124672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5015us (5422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137539.404029:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000040:00080000:1.0:1783137539.419438:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783137539.558926:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137540.408704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137540.408746:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137540.408785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137540.408848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137540.408877:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974362240 00000100:00100000:1.0:1783137540.408878:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974362112 00000100:00100000:2.0:1783137540.408889:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974362240 00000100:00100000:1.0:1783137540.408889:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974362112 00000100:00100000:0.0:1783137540.408959:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974362368 00000100:00100000:0.0:1783137540.408963:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974362368 00000100:00100000:1.0:1783137540.409020:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:1.0:1783137540.409031:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974362112:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137540.409107:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974362112:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 77us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137540.409115:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:3.0:1783137540.409174:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974361984 00000100:00100000:3.0:1783137540.409179:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974361984 00000100:00100000:3.0:1783137540.409218:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 274 00000100:00100000:3.0:1783137540.409225:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974361984:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137540.409254:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974361984:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137540.409260:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 274 00000100:00100000:0.0:1783137540.415589:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:0.0:1783137540.415607:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974362368:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137540.415694:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974362368:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 92us (6845us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137540.415698:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:0.0:1783137540.415708:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:2.0:1783137540.415714:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974362240:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137540.415909:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974362240:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 199us (7161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137540.415918:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00080000:1.0:1783137540.419003:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137540.419014:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1783137540.457611:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783137540.583742:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137541.610279:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137542.631229:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137543.080654:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990125696:0@lo:400:kworker.0 00000100:00100000:0.0:1783137543.080721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137543.080788:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137543.080815:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990125568:0@lo:400:kworker.0 00000100:00100000:0.0:1783137543.080842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137543.080873:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990125696 00000100:00100000:0.0:1783137543.080881:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990125696 00000100:00100000:0.0:1783137543.080934:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783137543.080942:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990125696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137543.080995:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990125696:12345-0@lo:400:kworker.0 Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137543.081002:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783137543.081024:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990125568 00000100:00100000:0.0:1783137543.081027:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990125568 00000100:00100000:0.0:1783137543.081053:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783137543.081059:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990125568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137543.081162:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990125440:0@lo:400:kworker.0 00000100:00100000:1.0:1783137543.081189:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137543.081207:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990125952:0@lo:400:kworker.0 00000100:00100000:1.0:1783137543.081252:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137543.081276:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783137543.081281:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990125312:0@lo:400:kworker.0 00000100:00100000:1.0:1783137543.081303:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137543.081402:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990125824:0@lo:400:kworker.0 00000100:00100000:1.0:1783137543.081424:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137543.081449:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990125312 00000100:00100000:1.0:1783137543.081453:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990125312 00000100:00100000:1.0:1783137543.081477:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1783137543.081483:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990125312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137543.081518:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990125312:12345-0@lo:400:kworker.0 Request processed in 35us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137543.081525:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1783137543.081565:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990125312:0@lo:400:kworker.0 00000100:00100000:1.0:1783137543.081602:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990125952 00000100:00100000:1.0:1783137543.081605:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990125952 00000100:00100000:1.0:1783137543.081630:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783137543.081636:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990125952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137543.081845:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990125440 00000100:00100000:3.0:1783137543.081850:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990125440 00000100:00100000:3.0:1783137543.081869:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990125824 00000100:00100000:3.0:1783137543.081871:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990125824 00000100:00100000:3.0:1783137543.081885:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783137543.081892:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990125440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137543.081926:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990125440:12345-0@lo:400:kworker.0 Request processed in 35us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137543.081933:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783137543.081945:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783137543.081951:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990125824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137543.081973:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990125824:12345-0@lo:400:kworker.0 Request processed in 23us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137543.081980:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1783137543.082010:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137543.082014:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137543.082016:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137543.082037:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990125696:0@lo:400:kworker.0 00000100:00100000:2.0:1783137543.082218:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990125824:0@lo:400:kworker.0 00000100:00100000:2.0:1783137543.082229:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990125440:0@lo:400:kworker.0 00010000:00080000:2.0:1783137543.082242:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709897dfb80 x1869754990125952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137543.082252:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990125952:0@lo:400:kworker.0 00000100:00100000:1.0:1783137543.082621:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990125952:12345-0@lo:400:kworker.0 Request processed in 36us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137543.082630:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783137543.083495:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990125568:12345-0@lo:400:kworker.0 Request processed in 2431us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137543.083504:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783137543.083669:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990125568:0@lo:400:kworker.0 00000100:00100000:3.0:1783137543.591768:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990126080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137543.591857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137543.593632:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990126080 00000100:00100000:0.0:1783137543.593644:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990126080 00000100:00100000:0.0:1783137543.593773:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783137543.593784:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990126080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137543.593843:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137543.593928:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990126080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137543.593952:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1783137543.594176:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709897de300 x1869754990126080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137543.594197:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990126080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137543.654945:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137544.103306:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137544.103340:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990126208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137544.103478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137544.110440:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990126208 00000100:00100000:1.0:1783137544.110456:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990126208 00000100:00100000:1.0:1783137544.110529:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783137544.110540:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990126208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137544.110579:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137544.110685:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990126208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (7206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137544.110692:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783137544.110971:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990126208:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783137544.678971:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137545.525870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137545.525913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137545.526028:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974362496 00000100:00100000:3.0:1783137545.526052:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974362496 00000100:00100000:3.0:1783137545.526161:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 276 00000100:00100000:3.0:1783137545.526174:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2353:x1869754974362496:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137545.526183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137545.526248:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2353:x1869754974362496:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 77us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137545.526256:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 276 00000100:00100000:0.0:1783137545.529689:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137545.529720:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974362752 00000100:00100000:0.0:1783137545.529729:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974362752 00000100:00100000:0.0:1783137545.529814:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:0.0:1783137545.529824:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2353:x1869754974362752:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137545.529888:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2353:x1869754974362752:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 66us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137545.529896:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00080000:0.0:1783137545.529964:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137545.531096:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974362624 00000100:00100000:1.0:1783137545.531105:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974362624 00000100:00100000:1.0:1783137545.531170:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974362880 00000100:00100000:1.0:1783137545.531174:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974362880 00000100:00100000:1.0:1783137545.531196:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:1.0:1783137545.531204:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2354:x1869754974362624:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137545.531260:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2354:x1869754974362624:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 56us (5346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137545.531267:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:1.0:1783137545.531280:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:1.0:1783137545.531285:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2354:x1869754974362880:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137545.531338:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2354:x1869754974362880:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 51us (5157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137545.531345:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 108 00000100:00080000:0.0:1783137545.535958:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783137545.702940:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137546.726998:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137547.751132:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137548.200810:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990126464:0@lo:400:kworker.0 00000100:00100000:2.0:1783137548.200893:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990126592:0@lo:400:kworker.0 00000100:00100000:0.0:1783137548.200930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137548.200936:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990126720:0@lo:400:kworker.0 00000100:00100000:2.0:1783137548.200989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137548.201017:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990126336:0@lo:400:kworker.0 00000100:00100000:0.0:1783137548.201020:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990126976:0@lo:400:kworker.0 00000100:00100000:2.0:1783137548.201040:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990126720 00000100:00100000:2.0:1783137548.201048:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990126720 00000100:00100000:3.0:1783137548.201058:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137548.201063:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137548.201092:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990126848:0@lo:400:kworker.0 00000100:00100000:2.0:1783137548.201100:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990126976 00000100:00100000:3.0:1783137548.201115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137548.201115:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990126976 00000100:00080000:0.0:1783137548.201115:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137548.201138:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783137548.201172:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990126336 00000100:00100000:3.0:1783137548.201176:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990126336 00000100:00100000:1.0:1783137548.201199:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990126464 00000100:00100000:1.0:1783137548.201205:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990126464 00000100:00100000:3.0:1783137548.201206:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1783137548.201217:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990126336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137548.201254:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990126848 00000100:00100000:1.0:1783137548.201259:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990126848 00000100:00100000:3.0:1783137548.201264:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990126336:12345-0@lo:400:kworker.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137548.201272:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1783137548.201287:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783137548.201295:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990126464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137548.201372:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990126464:12345-0@lo:400:kworker.0 Request processed in 77us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137548.201387:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990126336:0@lo:400:kworker.0 00000100:00100000:1.0:1783137548.201389:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783137548.201412:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783137548.201421:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990126848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137548.201464:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990126848:12345-0@lo:400:kworker.0 Request processed in 45us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137548.201471:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783137548.201515:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990126848:0@lo:400:kworker.0 00000100:00100000:1.0:1783137548.201543:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990126464:0@lo:400:kworker.0 00000100:00100000:2.0:1783137548.202041:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783137548.202050:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990126976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137548.202094:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990126976:12345-0@lo:400:kworker.0 Request processed in 46us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137548.202100:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1783137548.202130:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd916680 x1869754990126976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137548.202275:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990126976:0@lo:400:kworker.0 00000100:00100000:2.0:1783137548.202406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137548.202442:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990126592 00000100:00100000:2.0:1783137548.202447:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990126592 00000100:00100000:2.0:1783137548.202476:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783137548.202483:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990126592:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783137548.203218:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783137548.203224:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783137548.203961:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990126592:12345-0@lo:400:kworker.0 Request processed in 1473us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137548.203972:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783137548.204465:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990126592:0@lo:400:kworker.0 00000100:00100000:0.0:1783137548.208381:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990126720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137548.208557:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990126720:12345-0@lo:400:kworker.0 Request processed in 198us (7567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137548.208565:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783137548.209420:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990126720:0@lo:400:kworker.0 00000100:00100000:0.0:1783137548.711087:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137548.711110:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990127104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137548.711172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137548.712361:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990127104 00000100:00100000:1.0:1783137548.712369:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990127104 00000100:00100000:1.0:1783137548.712423:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783137548.712432:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990127104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137548.712463:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137548.712514:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990127104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137548.712521:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1783137548.712720:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709897dc000 x1869754990127104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137548.712737:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990127104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137548.774961:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137549.223080:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990127232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137549.223148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137549.223369:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990127232 00000100:00100000:1.0:1783137549.223377:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990127232 00000100:00100000:1.0:1783137549.223534:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783137549.223543:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990127232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137549.223669:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137549.223734:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990127232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137549.223741:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783137549.223834:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990127232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137549.798944:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137550.645427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137550.645467:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137550.645501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137550.645558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137550.645640:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974363136 00000100:00100000:1.0:1783137550.645649:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974363136 00000100:00100000:1.0:1783137550.645715:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974363392 00000100:00100000:1.0:1783137550.645719:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974363392 00000100:00100000:1.0:1783137550.645742:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:1.0:1783137550.645751:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974363136:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137550.645871:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974363136:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 120us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137550.645879:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:1.0:1783137550.645894:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:1.0:1783137550.645901:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974363392:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137550.645925:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974363392:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137550.645932:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:2.0:1783137550.646585:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974363264 00000100:00100000:2.0:1783137550.646592:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974363264 00000100:00100000:2.0:1783137550.646673:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:2.0:1783137550.646684:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974363264:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137550.646723:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974363264:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 41us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137550.646730:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00080000:0.0:1783137550.646944:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137550.646948:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137550.647458:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974363008 00000100:00100000:3.0:1783137550.647476:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974363008 00000100:00100000:3.0:1783137550.647518:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 278 00000100:00100000:3.0:1783137550.647527:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974363008:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137550.647586:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974363008:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 61us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137550.647593:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 278 00000040:00080000:1.0:1783137550.695503:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783137550.823212:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137551.847036:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137552.871209:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137553.319739:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990127744:0@lo:400:kworker.0 00000100:00100000:1.0:1783137553.319826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137553.319892:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137553.319899:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990127616:0@lo:400:kworker.0 00000100:00100000:1.0:1783137553.319923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137553.319951:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990127616 00000100:00100000:1.0:1783137553.319957:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990127616 00000100:00100000:1.0:1783137553.320020:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783137553.320028:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990127616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137553.320094:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990127616:12345-0@lo:400:kworker.0 Request processed in 66us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137553.320100:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1783137553.320121:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137553.320151:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990127616:0@lo:400:kworker.0 00000100:00100000:0.0:1783137553.320290:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990127360:0@lo:400:kworker.0 00000100:00100000:0.0:1783137553.320322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137553.320345:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990127872:0@lo:400:kworker.0 00000100:00100000:0.0:1783137553.320373:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137553.320389:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783137553.320394:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990127488:0@lo:400:kworker.0 00000100:00100000:0.0:1783137553.320411:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137553.320422:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990128000:0@lo:400:kworker.0 00000100:00100000:0.0:1783137553.320436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137553.320480:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990127744 00000100:00100000:0.0:1783137553.320484:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990127744 00000100:00100000:0.0:1783137553.320513:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990128000 00000100:00100000:0.0:1783137553.320516:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990128000 00000100:00100000:0.0:1783137553.320532:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783137553.320537:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990127744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137553.320570:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990127744:12345-0@lo:400:kworker.0 Request processed in 33us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137553.320577:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783137553.320588:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783137553.320595:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990128000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137553.320625:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990128000:12345-0@lo:400:kworker.0 Request processed in 31us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137553.320631:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1783137553.320655:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd856300 x1869754990128000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137553.320665:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990128000:0@lo:400:kworker.0 00000100:00100000:3.0:1783137553.320731:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990127360 00000100:00100000:3.0:1783137553.320735:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990127360 00000100:00100000:3.0:1783137553.320778:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1783137553.320785:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990127360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137553.320846:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990127872 00000100:00100000:3.0:1783137553.320848:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990127360:12345-0@lo:400:kworker.0 Request processed in 64us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137553.320854:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1783137553.320856:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990127872 00000100:00100000:2.0:1783137553.320878:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990127488 00000100:00100000:2.0:1783137553.320881:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990127488 00000100:00100000:2.0:1783137553.320895:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783137553.320896:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990127360:0@lo:400:kworker.0 00000100:00100000:2.0:1783137553.320901:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990127872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137553.320926:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783137553.320933:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990127488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137553.320937:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990127872:12345-0@lo:400:kworker.0 Request processed in 37us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137553.320943:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783137553.320958:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990127488:12345-0@lo:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137553.320964:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783137553.320978:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990127488:0@lo:400:kworker.0 00000100:00100000:2.0:1783137553.320988:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990127872:0@lo:400:kworker.0 00000100:00080000:1.0:1783137553.322910:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783137553.322919:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137553.322922:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137553.322968:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990127744:0@lo:400:kworker.0 00000100:00100000:2.0:1783137553.831099:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990128128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137553.831167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137553.831406:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990128128 00000100:00100000:0.0:1783137553.831414:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990128128 00000100:00100000:0.0:1783137553.831473:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783137553.831496:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990128128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137553.831531:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137553.831584:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990128128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137553.831592:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1783137553.831751:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709894e7100 x1869754990128128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137553.831768:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990128128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137553.895026:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137554.343166:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990128256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137554.343264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137554.343481:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990128256 00000100:00100000:0.0:1783137554.343490:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990128256 00000100:00100000:0.0:1783137554.343545:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783137554.343564:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990128256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137554.343615:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137554.344471:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990128256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 915us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137554.344481:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783137554.344688:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990128256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137554.918982:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137555.768546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137555.768600:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137555.768707:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974363648 00000100:00100000:2.0:1783137555.768716:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974363648 00000100:00100000:2.0:1783137555.768784:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:2.0:1783137555.768825:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2354:x1869754974363648:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137555.768897:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2354:x1869754974363648:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 104us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137555.768905:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00080000:1.0:1783137555.769136:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137555.769289:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974363520 00000100:00100000:3.0:1783137555.769295:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974363520 00000100:00100000:3.0:1783137555.769454:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 280 00000100:00100000:3.0:1783137555.769504:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2354:x1869754974363520:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137555.769556:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2354:x1869754974363520:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 55us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137555.769564:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 280 00000100:00100000:2.0:1783137555.788348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137555.788399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137555.788491:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974363776 00000100:00100000:0.0:1783137555.788500:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974363776 00000100:00100000:0.0:1783137555.788571:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:0.0:1783137555.788581:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2350:x1869754974363776:12345-192.168.203.36@tcp:9:kworker.0 00000020:00000080:0.0:1783137555.788611:0:6620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674afc 00000100:00080000:0.0:1783137555.788620:0:6620:0:(import.c:65:import_set_state_nolock()) ffff9709b791f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783137555.788659:0:6620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1783137555.788948:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+2:2350:x1869754974363776:12345-192.168.203.36@tcp:9:kworker.0 Request processed in 368us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137555.788956:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00010000:00010000:0.0:1783137555.788974:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783137555.789177:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137555.789317:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974363904 00000100:00100000:1.0:1783137555.789322:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974363904 00000100:00100000:1.0:1783137555.789370:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:1.0:1783137555.789378:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2353:x1869754974363904:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137555.789418:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2353:x1869754974363904:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 41us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137555.789424:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00080000:2.0:1783137555.790263:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783137555.944293:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137556.966985:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783137557.989640:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:0.0:1783137557.989648:0:6644:0:(genops.c:906:class_export_put()) final put ffff9709b791c000/d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:2.0:1783137557.990924:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b791c000/d717cef4-1367-4dd9-ae68-a0c1ee666834 for lustre-OST0000 00000020:00000080:2.0:1783137557.990996:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b791f800 for lustre-OST0000 00010000:00010000:2.0:1783137557.992378:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137558.442943:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990128512:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137558.443065:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990129024:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443087:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137558.443116:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783137558.443122:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990128384:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443146:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137558.443166:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990128896:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137558.443211:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990128768:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137558.443264:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783137558.443269:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990128640:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443289:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137558.443316:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990128512 00000100:00100000:0.0:1783137558.443322:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990128512 00000100:00100000:0.0:1783137558.443359:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990128896 00000100:00100000:0.0:1783137558.443362:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990128896 00000100:00100000:0.0:1783137558.443381:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990128640 00000100:00100000:0.0:1783137558.443384:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990128640 00000100:00100000:0.0:1783137558.443401:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783137558.443408:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990128512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443457:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990128512:12345-0@lo:400:kworker.0 Request processed in 48us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137558.443479:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783137558.443495:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783137558.443501:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990128896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443528:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990128896:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137558.443533:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783137558.443543:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783137558.443549:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990128640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443579:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990128640:12345-0@lo:400:kworker.0 Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137558.443585:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783137558.443602:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990129024 00000100:00100000:0.0:1783137558.443605:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990129024 00000100:00100000:0.0:1783137558.443629:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990128768 00000100:00100000:0.0:1783137558.443632:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990128768 00000100:00100000:0.0:1783137558.443655:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783137558.443662:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990129024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443693:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990129024:12345-0@lo:400:kworker.0 Request processed in 32us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137558.443699:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783137558.443710:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783137558.443716:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990128768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443759:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990128768:12345-0@lo:400:kworker.0 Request processed in 43us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137558.443765:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783137558.443808:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990128384 00000100:00100000:0.0:1783137558.443812:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990128384 00000100:00100000:0.0:1783137558.443836:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1783137558.443842:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990128384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443872:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990128384:12345-0@lo:400:kworker.0 Request processed in 30us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137558.443877:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:0.0:1783137558.443910:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137558.443914:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137558.443916:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137558.443944:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990128640:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443955:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990128768:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443981:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990128384:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443991:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990128896:0@lo:400:kworker.0 00000100:00100000:0.0:1783137558.443999:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990128512:0@lo:400:kworker.0 00010000:00080000:0.0:1783137558.444009:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709894e4380 x1869754990129024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137558.444018:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990129024:0@lo:400:kworker.0 00000100:00100000:1.0:1783137558.963729:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137558.963752:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990129152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137558.963833:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137558.964072:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990129152 00000100:00100000:3.0:1783137558.964080:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990129152 00000100:00100000:3.0:1783137558.964135:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783137558.964145:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990129152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137558.964181:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137558.964239:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990129152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137558.964246:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1783137558.964284:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd857480 x1869754990129152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137558.964302:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990129152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137559.015633:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137559.463062:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137559.463084:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990129280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137559.463146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137559.463205:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990129280 00000100:00100000:2.0:1783137559.463211:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990129280 00000100:00100000:2.0:1783137559.463267:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783137559.463275:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990129280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137559.463311:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137559.463350:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990129280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137559.463356:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783137559.463397:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990129280:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783137560.039194:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137560.899553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137560.902461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137560.902503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137560.902537:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974364288 00000100:00100000:2.0:1783137560.902546:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974364288 00000100:00100000:2.0:1783137560.902599:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974364160 00000100:00100000:2.0:1783137560.902602:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974364160 00000100:00100000:2.0:1783137560.902629:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:2.0:1783137560.902638:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974364288:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137560.902708:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974364288:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137560.902727:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:2.0:1783137560.902748:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 123 00000100:00100000:2.0:1783137560.902756:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974364160:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137560.902784:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974364160:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137560.902817:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 123 00000100:00080000:2.0:1783137560.902836:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137560.911681:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974364032 00000100:00100000:0.0:1783137560.911695:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974364032 00000100:00100000:1.0:1783137560.914126:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 282 00000100:00100000:1.0:1783137560.914140:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974364032:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137560.914235:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974364032:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 98us (14691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137560.914244:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 282 00000040:00080000:3.0:1783137560.937014:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783137561.064490:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783137561.247143:0:11744:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:59:19 (1783137559) 00010000:00010000:1.0:1783137562.087097:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137562.719309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137562.719572:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974364416 00000100:00100000:0.0:1783137562.719592:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974364416 00000100:00100000:0.0:1783137562.719668:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:0.0:1783137562.719680:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:10227:x1869754974364416:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137562.719712:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137562.719808:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674bc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727c1 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137562.719868:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674bce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137562.719881:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137562.719893:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137562.720172:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783137562.720177:0:7113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00080000:2.0:1783137562.720543:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1783137562.720738:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137562.720768:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674bc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727c1 expref: 7 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137562.720785:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674bce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727c1 expref: 6 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137562.720876:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4b00) 00010000:00010000:0.0:1783137562.720879:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137562.720883:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235800, rc 0) 00000100:00100000:0.0:1783137562.720953:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:10227:x1869754974364416:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 1276us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137562.720961:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:2.0:1783137562.727440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137562.727588:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974364544 00000100:00100000:3.0:1783137562.727597:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974364544 00000100:00100000:3.0:1783137562.727654:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:3.0:1783137562.727665:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:10228:x1869754974364544:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137562.727685:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137562.727703:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674bd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727c8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.727780:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.727820:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.727832:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.727846:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.727852:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.727858:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.728186:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005000/0x88def104ac674bea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.728205:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005000/0x88def104ac674bea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.728213:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005000/0x88def104ac674bea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137562.730059:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783137562.730069:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137562.730159:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005000/0x88def104ac674bea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730201:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730207:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730214:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730219:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137562.730224:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730744:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730766:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4b00) 00010000:00010000:3.0:1783137562.730769:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137562.730774:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730780:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674bdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730824:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730832:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730837:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730851:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137562.730854:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730861:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730869:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff970987960f00) 00010000:00010000:3.0:1783137562.730872:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137562.730875:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730882:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674be3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.730988:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674bd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727c8 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.731005:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005000/0x88def104ac674bea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727c8 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137562.731012:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff970987960d00) 00010000:00010000:3.0:1783137562.731014:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137562.731016:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005000, rc 0) 00000100:00100000:3.0:1783137562.731146:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:10228:x1869754974364544:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 3482us (3712us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137562.731154:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:3.0:1783137562.735304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137562.738104:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974364800 00000100:00100000:2.0:1783137562.738118:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974364800 00000100:00100000:2.0:1783137562.738181:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1783137562.738202:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:10228:x1869754974364800:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137562.738222:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137562.738242:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674bf1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727cf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.738310:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.738323:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.738333:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.740058:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.740077:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.740086:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.743334:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050800/0x88def104ac674c06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.743357:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050800/0x88def104ac674c06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.743367:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050800/0x88def104ac674c06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137562.743380:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783137562.744251:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744263:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744270:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744276:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137562.744280:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744298:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744311:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff970987960d00) 00010000:00010000:2.0:1783137562.744314:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137562.744317:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744324:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac674bf8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744336:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744340:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744345:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744349:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137562.744352:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744357:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744363:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff970990e98f00) 00010000:00010000:2.0:1783137562.744365:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137562.744368:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.744382:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674bff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.745590:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674bf1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727cf expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.745612:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050800/0x88def104ac674c06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727cf expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137562.745620:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:2.0:1783137562.745623:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137562.745626:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050800, rc 0) 00000100:00100000:2.0:1783137562.745704:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:10228:x1869754974364800:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 7514us (10409us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783137562.745713:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1783137562.751705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137562.751836:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974364928 00000100:00100000:0.0:1783137562.751847:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974364928 00000100:00100000:0.0:1783137562.751910:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:0.0:1783137562.751920:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:10228:x1869754974364928:12345-192.168.203.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783137562.752025:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:10228:x1869754974364928:12345-192.168.203.36@tcp:59:lhsmtool_posix.0 Request processed in 106us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137562.752034:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 35 00000040:00080000:3.0:1783137562.983473:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783137563.113092:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137563.560067:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990129536:0@lo:400:kworker.0 00000100:00100000:0.0:1783137563.560133:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985323b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990129408:0@lo:400:kworker.0 00000100:00100000:2.0:1783137563.560142:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137563.560178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137563.560204:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990130048:0@lo:400:kworker.0 00000100:00100000:0.0:1783137563.560223:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990129920:0@lo:400:kworker.0 00000100:00100000:0.0:1783137563.560250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137563.560283:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137563.560318:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990129664:0@lo:400:kworker.0 00000100:00100000:2.0:1783137563.560340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137563.560358:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137563.560364:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990129792:0@lo:400:kworker.0 00000100:00100000:2.0:1783137563.560399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137563.560441:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990129536 00000100:00100000:2.0:1783137563.560448:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990129536 00000100:00100000:2.0:1783137563.560487:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990129920 00000100:00100000:2.0:1783137563.560490:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990129920 00000100:00100000:2.0:1783137563.560522:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990129664 00000100:00100000:2.0:1783137563.560525:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990129664 00000100:00100000:2.0:1783137563.560541:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783137563.560548:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990129536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137563.560660:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990129408 00000100:00100000:0.0:1783137563.560665:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990129408 00000100:00100000:0.0:1783137563.560765:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1783137563.560772:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990129408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137563.560845:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990129408:12345-0@lo:400:kworker.0 Request processed in 72us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137563.560861:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990129536:12345-0@lo:400:kworker.0 Request processed in 312us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137563.560869:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783137563.560886:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783137563.560892:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990129920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137563.560918:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990129920:12345-0@lo:400:kworker.0 Request processed in 27us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137563.560924:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1783137563.560970:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985323b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990129408:0@lo:400:kworker.0 00000100:00100000:0.0:1783137563.560982:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990129920:0@lo:400:kworker.0 00000100:00100000:2.0:1783137563.561076:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783137563.561093:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783137563.561101:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990129664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137563.561213:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990129664:12345-0@lo:400:kworker.0 Request processed in 113us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137563.561219:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783137563.561241:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990130048 00000100:00100000:2.0:1783137563.561244:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990130048 00000100:00100000:2.0:1783137563.561270:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990129792 00000100:00100000:2.0:1783137563.561273:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990129792 00000100:00100000:2.0:1783137563.561293:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783137563.561299:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990130048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137563.561328:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990130048:12345-0@lo:400:kworker.0 Request processed in 30us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137563.561341:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783137563.561352:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783137563.561358:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990129792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137563.561387:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990129792:12345-0@lo:400:kworker.0 Request processed in 30us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137563.561392:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1783137563.561416:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783137563.561420:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137563.561421:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137563.561445:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990129536:0@lo:400:kworker.0 00010000:00080000:2.0:1783137563.561457:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b7cab480 x1869754990130048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783137579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137563.561466:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990130048:0@lo:400:kworker.0 00000100:00100000:0.0:1783137563.562659:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990129792:0@lo:400:kworker.0 00000100:00100000:0.0:1783137563.562674:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990129664:0@lo:400:kworker.0 00000100:00100000:0.0:1783137564.074041:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990130176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137564.074123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137564.074538:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990130176 00000100:00100000:3.0:1783137564.074547:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990130176 00000100:00100000:3.0:1783137564.074601:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783137564.074610:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990130176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137564.074645:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137564.074702:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990130176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137564.074709:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1783137564.074831:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bd855880 x1869754990130176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137564.074849:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990130176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137564.136228:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137564.584585:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137564.584609:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990130304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137564.584674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137564.584835:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990130304 00000100:00100000:3.0:1783137564.584843:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990130304 00000100:00100000:3.0:1783137564.584904:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783137564.584913:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990130304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137564.584946:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137564.585045:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990130304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137564.585053:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783137564.589895:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990130304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137564.774196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137564.774265:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974365056 00000100:00100000:3.0:1783137564.774274:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974365056 00000100:00100000:3.0:1783137564.774344:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:3.0:1783137564.774355:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:10270:x1869754974365056:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137564.774374:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137564.774392:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674c14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727d6 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774525:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774548:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774560:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774576:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774583:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774589:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774881:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774889:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774897:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774903:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137564.774917:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774926:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774938:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4b00) 00010000:00010000:3.0:1783137564.774946:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137564.774951:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774957:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674c1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774969:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774975:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774982:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774987:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137564.774990:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.774996:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.775004:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff970987960a00) 00010000:00010000:3.0:1783137564.775007:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137564.775009:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.775015:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.775047:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674c14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727d6 expref: 10 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.775069:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4b00) 00010000:00010000:3.0:1783137564.775072:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137564.775077:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674c14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727d6 expref: 10 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.775086:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005c00, rc 0) 00000100:00100000:3.0:1783137564.775145:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:10270:x1869754974365056:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 791us (955us total) trans 0 rc 301/301 00000100:00100000:3.0:1783137564.775152:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00080000:0.0:1783137564.775378:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137564.785984:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137564.786077:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974365312 00000100:00100000:2.0:1783137564.786086:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974365312 00000100:00100000:2.0:1783137564.786141:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:2.0:1783137564.786150:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:10270:x1869754974365312:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1783137564.786214:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137564.786241:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac674bce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727c1 expref: 9 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.786261:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4b00) 00010000:00010000:2.0:1783137564.786271:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137564.786549:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.786572:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.786581:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.786592:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.786598:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.786604:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137564.791001:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783137564.791023:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.791033:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.791042:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.791048:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137564.791052:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.791060:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.791095:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98600) 00010000:00010000:2.0:1783137564.791098:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137564.791102:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.791109:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674c29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137564.791131:0:5814:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f2d88ed reply state 0000000014fce96b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137564.791141:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137564.791261:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:10270:x1869754974365312:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 5107us (5283us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783137564.791269:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00010000:00010000:3.0:1783137564.795267:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.795285:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.795293:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.795299:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137564.795305:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.795312:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.795328:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff970990e98a00) 00010000:00010000:3.0:1783137564.795331:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137564.795343:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.795349:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674c30 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137564.876560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137564.876993:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974365440 00000100:00100000:3.0:1783137564.877003:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974365440 00000100:00100000:3.0:1783137564.877055:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:3.0:1783137564.877065:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:10278:x1869754974365440:12345-192.168.203.36@tcp:101:lctl.0 00010000:00010000:3.0:1783137564.877087:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137564.877108:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674c37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727dd expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.877169:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.877191:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.877202:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137564.877259:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783137564.877263:0:7113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137564.877303:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.877328:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674c37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727dd expref: 11 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.877345:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727dd expref: 10 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.877364:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:3.0:1783137564.877368:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137564.877371:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004200, rc 0) 00000100:00100000:3.0:1783137564.877989:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:10278:x1869754974365440:12345-192.168.203.36@tcp:101:lctl.0 Request processed in 900us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137564.877999:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:3.0:1783137564.933380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137564.934421:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974365568 00000100:00100000:0.0:1783137564.934433:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974365568 00000100:00100000:0.0:1783137564.934496:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:0.0:1783137564.934505:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:10284:x1869754974365568:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137564.934524:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137564.934543:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727e4 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934600:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934612:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934622:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934635:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934656:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934663:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934778:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac674c5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934786:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac674c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934820:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac674c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137564.934854:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783137564.934858:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137564.934896:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac674c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934917:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934924:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934931:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934940:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137564.934945:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934959:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934971:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:0.0:1783137564.934975:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137564.934979:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934985:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.934998:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.935003:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.935009:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.935015:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137564.935017:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.935023:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.935030:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9709860f4a00) 00010000:00010000:0.0:1783137564.935032:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137564.935035:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.935049:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674c53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.935628:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727e4 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.935646:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac674c5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727e4 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.935653:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137564.935655:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783137564.935657:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235400, rc 0) 00000100:00100000:2.0:1783137564.936118:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:10284:x1869754974365568:12345-192.168.203.36@tcp:101:bash.0 Request processed in 1611us (2742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137564.936127:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:0.0:1783137564.940763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137564.941234:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974365824 00000100:00100000:3.0:1783137564.941243:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974365824 00000100:00100000:2.0:1783137564.941457:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:2.0:1783137564.941469:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:10284:x1869754974365824:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1783137564.941489:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137564.941508:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674c61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727eb expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.941639:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.941671:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.941682:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.941738:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.941747:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.941754:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783137564.942435:0:7113:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1783137564.942600:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942611:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942620:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942655:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942662:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942668:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942681:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137564.942685:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942692:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942704:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:2.0:1783137564.942707:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137564.942711:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942717:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674c68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137564.942730:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db6a104e reply state 000000001481f9c0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137564.942738:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783137564.942771:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674c61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727eb expref: 14 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.942785:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727eb expref: 13 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.943453:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:2.0:1783137564.943457:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137564.943460:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051e00, rc 0) 00000100:00100000:2.0:1783137564.943583:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:10284:x1869754974365824:12345-192.168.203.36@tcp:101:bash.0 Request processed in 2117us (2829us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783137564.943598:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:2.0:1783137564.949950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137564.949995:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974365952 00000100:00100000:3.0:1783137564.950005:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974365952 00000100:00100000:3.0:1783137564.950053:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:3.0:1783137564.950061:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1869754974365952:12345-192.168.203.36@tcp:8:bash.0 00010000:00080000:3.0:1783137564.950135:0:6619:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:3.0:1783137564.950163:0:6619:0:(genops.c:1406:class_connect()) connect: client d717cef4-1367-4dd9-ae68-a0c1ee666834, cookie 0x88def104ac674c84 00002000:00100000:3.0:1783137564.950188:0:6619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d717cef4-1367-4dd9-ae68-a0c1ee666834/ffff9709b7990000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00010000:00010000:1.0:1783137564.950345:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137564.950365:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137564.950371:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137564.950377:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137564.950380:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137564.950388:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137564.950409:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970990e98600) 00010000:00010000:1.0:1783137564.950412:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137564.950417:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137564.950423:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674c6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1783137564.950431:0:6619:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783137564.950673:0:6619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783137564.950701:0:6619:0:(import.c:65:import_set_state_nolock()) ffff9709b7994000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137564.950769:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2350:x1869754974365952:12345-192.168.203.36@tcp:8:bash.0 Request processed in 707us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137564.950778:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1783137564.953037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137564.953266:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974366080 00000100:00100000:2.0:1783137564.953277:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974366080 00000100:00100000:2.0:1783137564.953401:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:2.0:1783137564.953414:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:0:x1869754974366080:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1783137564.953432:0:6620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137564.953456:0:6620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727f2 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137564.953483:0:6620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137564.953502:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:2.0:1783137564.953506:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137564.953514:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f2 expref: 7 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.953532:0:6620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f2 expref: 7 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137564.953544:0:6620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050400, rc 0) 00000100:00100000:2.0:1783137564.953601:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:0:x1869754974366080:12345-192.168.203.36@tcp:101:bash.0 Request processed in 191us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137564.953608:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00080000:0.0:1783137564.960586:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137564.962637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137564.963273:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974366208 00000100:00100000:1.0:1783137564.963283:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974366208 00000100:00100000:3.0:1783137564.963489:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:3.0:1783137564.963501:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:10284:x1869754974366208:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:3.0:1783137564.963529:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137564.963548:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec727f9 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.963579:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f2 expref: 8 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.963589:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137564.963593:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137564.963599:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.963633:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f2 expref: 8 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.963647:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f2 expref: 8 pid: 6620 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137564.963661:0:6619:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6619:1869754990130432:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137564.963748:0:6619:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709b784f240 going to sleep for 11 seconds 00000100:00100000:1.0:1783137564.966025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137564.966118:0:6619:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6619:1869754990130432:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137564.966157:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137564.966187:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005c00, rc 0) 00000100:00100000:3.0:1783137564.966258:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:10284:x1869754974366208:12345-192.168.203.36@tcp:101:bash.0 Request processed in 2758us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137564.966267:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:0.0:1783137564.967629:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974366336 00000100:00100000:0.0:1783137564.967640:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974366336 00010000:00010000:0.0:1783137564.967681:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f2 expref: 8 pid: 6620 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137564.967710:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:0.0:1783137564.967719:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974366336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137564.967731:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137564.967752:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f2 expref: 8 pid: 6620 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.967780:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f2 expref: 8 pid: 6620 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.967825:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac674c8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f2 expref: 8 pid: 6620 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.967842:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137564.967846:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137564.967854:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.967863:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137564.967896:0:8403:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137564.967919:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970985322d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8403:1869754990130560:192.168.203.36@tcp:105: 00000100:00100000:0.0:1783137564.967993:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709861d8300 going to sleep for 11 seconds 00000100:00100000:1.0:1783137564.972321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137564.972345:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970985322d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8403:1869754990130560:192.168.203.36@tcp:105: 00010000:00010000:0.0:1783137564.972371:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137564.972436:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2351:x1869754974366336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4708us (6409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137564.972448:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:2.0:1783137564.972813:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974366592 00000100:00100000:2.0:1783137564.972819:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974366592 00000100:00100000:2.0:1783137564.972855:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:2.0:1783137564.972872:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:10284:x1869754974366592:12345-192.168.203.36@tcp:35:bash.0 00000100:00100000:2.0:1783137564.973939:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:10284:x1869754974366592:12345-192.168.203.36@tcp:35:bash.0 Request processed in 1065us (1622us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783137564.973948:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:1.0:1783137565.053646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.053757:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974366848 00000100:00100000:2.0:1783137565.053767:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974366848 00000100:00100000:2.0:1783137565.053861:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:2.0:1783137565.053871:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:10294:x1869754974366848:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137565.053894:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137565.053921:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674c99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72800 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137565.054022:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783137565.055512:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674c99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72800 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.055532:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:2.0:1783137565.055535:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137565.055540:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674c99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72800 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.055555:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051000, rc 0) 00000100:00100000:2.0:1783137565.055620:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:10294:x1869754974366848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1750us (1984us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1783137565.055629:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:0.0:1783137565.067997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.068061:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974367104 00000100:00100000:2.0:1783137565.068084:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974367104 00000100:00100000:2.0:1783137565.068242:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:2.0:1783137565.068253:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:10294:x1869754974367104:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137565.068518:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:10294:x1869754974367104:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 266us (529us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783137565.068526:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00010000:00010000:1.0:1783137565.159075:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137565.161677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137565.161771:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974367232 00000100:00100000:1.0:1783137565.161780:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974367232 00000100:00100000:1.0:1783137565.161868:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:1.0:1783137565.161877:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:10300:x1869754974367232:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1783137565.161898:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137565.161925:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72807 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.161988:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674cae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.162001:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.162011:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137565.162065:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1783137565.162068:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137565.162094:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.162137:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72807 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.162368:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674cae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72807 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.162396:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:1.0:1783137565.162399:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137565.162401:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0ce00, rc 0) 00000100:00100000:1.0:1783137565.162451:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:10300:x1869754974367232:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 574us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137565.162457:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:0.0:1783137565.166409:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.166504:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974367488 00000100:00100000:2.0:1783137565.166513:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974367488 00000100:00100000:2.0:1783137565.166568:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:2.0:1783137565.166577:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:10300:x1869754974367488:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137565.166595:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137565.166613:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674cb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7280e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.166703:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674cbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.166719:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.166729:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137565.166738:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783137565.166899:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674cb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7280e expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.166928:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7280e expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.166953:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:2.0:1783137565.166956:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137565.166960:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050e00, rc 0) 00000100:00100000:2.0:1783137565.167014:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:10300:x1869754974367488:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 438us (614us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783137565.167020:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1783137565.172093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137565.172480:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974367616 00000100:00100000:3.0:1783137565.172490:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974367616 00000100:00100000:3.0:1783137565.172552:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:3.0:1783137565.172563:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:2354:x1869754974367616:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137565.172578:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137565.172600:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674cbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7280e expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.172620:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:3.0:1783137565.172625:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137565.172682:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:2354:x1869754974367616:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 120us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137565.172690:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:0.0:1783137565.175008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.175151:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974367872 00000100:00100000:2.0:1783137565.175160:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974367872 00000100:00100000:2.0:1783137565.175229:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:2.0:1783137565.175239:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:10300:x1869754974367872:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137565.175260:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137565.175278:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674cca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72815 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.175364:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674cd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.175378:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.175399:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137565.175411:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783137565.175521:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674cca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72815 expref: 21 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.175554:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674cd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72815 expref: 20 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.175561:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:2.0:1783137565.175564:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783137565.175567:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051600, rc 0) 00000100:00100000:2.0:1783137565.175619:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:10300:x1869754974367872:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 382us (620us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783137565.175626:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:0.0:1783137565.195677:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.195766:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974368000 00000100:00100000:2.0:1783137565.195775:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974368000 00000100:00100000:2.0:1783137565.195847:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1783137565.195857:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974368000:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1783137565.196152:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.196180:0:6620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.196189:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783137565.196193:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137565.196198:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.196230:0:6620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.196250:0:6620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 7 pid: 6619 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137565.196264:0:6620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd920380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6620:1869754990130688:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137565.196977:0:6620:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57780 going to sleep for 11 seconds 00000100:00100000:0.0:1783137565.202620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137565.202734:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974368128 00000100:00100000:1.0:1783137565.202743:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974368128 00002000:00100000:1.0:1783137565.202816:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9709bd6d8e00 x1869754974368128/t0(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:471/0 lens 504/0 e 0 to 0 dl 1783137576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783137565.202827:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd6d8e00 with x1869754974368128 ext(0->12) 00010000:00010000:1.0:1783137565.202837:0:6624:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 8 pid: 6619 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.202852:0:6624:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 8 pid: 6619 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137565.202860:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9709bd6d8e00 00000100:00100000:1.0:1783137565.202891:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:1.0:1783137565.203071:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2354:x1869754974368128:12345-192.168.203.36@tcp:4:lfs.0 00000100:00100000:2.0:1783137565.203636:0:6620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd920380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6620:1869754990130688:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137565.203660:0:6620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1783137565.262591:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000100:00100000:3.0:1783137565.275860:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2354:x1869754974368128:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 72947us (73235us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783137565.275880:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00002000:00100000:3.0:1783137565.275891:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9709bd6d8e00 x1869754974368128/t4294967299(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:471/0 lens 504/448 e 0 to 0 dl 1783137576 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783137565.275902:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd6d8e00 with x1869754974368128 ext(0->12) 00010000:00010000:3.0:1783137565.275914:0:6624:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 9 pid: 6619 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.275955:0:6624:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 9 pid: 6619 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137565.275963:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9709bd6d8e00 00000100:00100000:0.0:1783137565.280359:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.280444:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974368256 00000100:00100000:2.0:1783137565.280453:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974368256 00010000:00010000:2.0:1783137565.280493:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 9 pid: 6619 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137565.280541:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:2.0:1783137565.280552:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2353:x1869754974368256:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137565.280566:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783137565.280585:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783137565.280588:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783137564 00002000:00010000:2.0:1783137565.280590:0:5799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783137564 00002000:00010000:2.0:1783137565.280592:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783137564 00010000:00010000:2.0:1783137565.280597:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 9 pid: 6619 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.280630:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 9 pid: 6619 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.280652:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac674c92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727f9 expref: 9 pid: 6619 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.280670:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137565.280674:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137565.280680:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.280688:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.280723:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137565.280857:0:6620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.280867:0:6620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.280893:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.280902:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.280921:0:6620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.280928:0:6620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137565.280932:0:6620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.280940:0:6620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.280966:0:6620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.280975:0:6620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac674cdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137565.281188:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2353:x1869754974368256:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 635us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137565.281197:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:3.0:1783137565.289918:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974368000:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 94042us (94228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137565.289933:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:0.0:1783137565.305550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137565.305664:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974368512 00000100:00100000:1.0:1783137565.305675:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974368512 00000100:00100000:1.0:1783137565.305734:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:1.0:1783137565.305745:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:10300:x1869754974368512:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:1.0:1783137565.305854:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674cd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72815 expref: 20 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783137565.306120:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1783137565.306199:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1783137565.306978:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1783137565.307036:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.307054:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727eb expref: 24 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.307063:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.307095:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727eb expref: 24 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.307110:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727eb expref: 24 pid: 7113 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137565.307124:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd857b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1869754990130816:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137565.307700:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea780 going to sleep for 11 seconds 00000100:00100000:1.0:1783137565.310973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137565.311072:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974368640 00000100:00100000:3.0:1783137565.311081:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974368640 00000100:00100000:2.0:1783137565.311085:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd857b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1869754990130816:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137565.311115:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.311120:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727eb expref: 25 pid: 7113 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137565.311153:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:3.0:1783137565.311162:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+25:2351:x1869754974368640:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137565.311184:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137565.311191:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727eb expref: 25 pid: 7113 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.311204:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727eb expref: 25 pid: 7113 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.311222:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac674c76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727eb expref: 25 pid: 7113 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.311251:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:3.0:1783137565.311256:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.311265:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.311272:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.311297:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137565.311352:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:2351:x1869754974368640:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 191us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137565.311359:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00010000:00010000:2.0:1783137565.311523:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.311533:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137565.311657:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1783137565.312761:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1783137565.312932:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6dad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990130944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783137565.313014:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137565.313111:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab2906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137565.313250:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990130944 00000100:00100000:3.0:1783137565.313258:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990130944 00000100:00100000:3.0:1783137565.313331:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137565.313339:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1869754990130944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783137565.313420:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1869754990130944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137565.313427:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783137565.313584:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783137565.313654:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6dad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990130944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783137565.314506:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1783137565.314575:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd920380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990131072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783137565.314618:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137565.314649:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137565.314871:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990131072 00000100:00100000:1.0:1783137565.314878:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990131072 00000100:00100000:1.0:1783137565.314927:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137565.314936:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5818:x1869754990131072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783137565.315204:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1869754990131072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 268us (584us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783137565.315212:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137565.319740:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd920380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990131072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783137565.319894:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1783137565.319955:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.319966:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.319996:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.320003:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137565.320008:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.320506:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.320679:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:2.0:1783137565.320683:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783137565.320689:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.320714:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ce6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783137565.320951:0:5818:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783137565.321188:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1783137565.321200:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321218407550ns, next at 322218405520ns, rc = 0 00000001:00080000:2.0:1783137565.321208:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1783137565.321592:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:2.0:1783137565.321596:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783137565.321708:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674cd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72815 expref: 28 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137565.321863:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:10300:x1869754974368512:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 16119us (16321us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783137565.321872:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000020:00080000:2.0:1783137565.321878:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783137565.331623:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137565.331773:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974368768 00000100:00100000:3.0:1783137565.331784:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974368768 00000100:00100000:3.0:1783137565.331869:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:3.0:1783137565.331879:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:10300:x1869754974368768:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137565.331903:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137565.331999:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674ced lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7281c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.332531:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674ced lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7281c expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.332554:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674ced lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7281c expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.332661:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:1.0:1783137565.332665:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137565.332668:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004c00, rc 0) 00000100:00100000:1.0:1783137565.332731:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:10300:x1869754974368768:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 852us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137565.332739:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:0.0:1783137565.338622:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.339198:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974369024 00000100:00100000:2.0:1783137565.339208:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974369024 00000100:00100000:2.0:1783137565.339267:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:2.0:1783137565.339278:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:10300:x1869754974369024:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137565.339637:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:10300:x1869754974369024:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 360us (1023us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1783137565.339645:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:0.0:1783137565.416298:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.416397:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974369280 00000100:00100000:2.0:1783137565.416407:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974369280 00000100:00100000:2.0:1783137565.416462:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:2.0:1783137565.416471:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:10310:x1869754974369280:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137565.416504:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137565.416522:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674cf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72823 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137565.416734:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783137565.416978:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674cf4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72823 expref: 31 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.416993:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:2.0:1783137565.416997:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137565.417003:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674cf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72823 expref: 31 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.417017:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051600, rc 0) 00000100:00100000:2.0:1783137565.417107:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:10310:x1869754974369280:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 636us (816us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1783137565.417115:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:1.0:1783137565.426329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137565.426398:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974369408 00000100:00100000:0.0:1783137565.426408:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974369408 00000100:00100000:0.0:1783137565.426463:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:0.0:1783137565.426473:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:10310:x1869754974369408:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:0.0:1783137565.426541:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.426557:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.426577:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.426592:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.426612:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.426620:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.426734:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.426743:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.426749:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137565.426787:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427016:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427021:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427028:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427033:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137565.427037:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427045:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427063:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137565.427066:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137565.427071:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427077:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac674d02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427090:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427096:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427100:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427105:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137565.427108:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427113:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427119:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9709860f4400) 00010000:00010000:0.0:1783137565.427121:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137565.427124:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427128:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac674d09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427164:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427170:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427185:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427189:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137565.427192:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427197:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427205:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:0.0:1783137565.427208:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137565.427210:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.427216:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac674d10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137565.427282:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:10310:x1869754974369408:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 810us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137565.427289:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:0.0:1783137565.429337:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.429401:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974369664 00000100:00100000:2.0:1783137565.429410:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974369664 00000100:00100000:2.0:1783137565.429460:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:2.0:1783137565.429469:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:10310:x1869754974369664:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137565.429741:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:10310:x1869754974369664:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 273us (411us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1783137565.429749:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1783137565.461966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137565.462076:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974369920 00000100:00100000:3.0:1783137565.462085:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974369920 00000100:00100000:3.0:1783137565.462154:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:3.0:1783137565.462164:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:10313:x1869754974369920:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137565.462196:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137565.462215:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac674d17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7282a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462284:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462297:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462308:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462320:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462326:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462350:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462479:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462488:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462495:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137565.462504:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783137565.462969:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462979:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462986:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.462992:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137565.462995:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463004:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463016:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:3.0:1783137565.463019:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137565.463031:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463038:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674d1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463050:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463056:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463062:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463067:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137565.463070:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463076:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463085:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970987960600) 00010000:00010000:3.0:1783137565.463087:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137565.463090:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.463094:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674d25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.463779:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac674d17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7282a expref: 34 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.463841:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7282a expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.463850:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:2.0:1783137565.463853:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137565.463855:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005200, rc 0) 00000100:00100000:2.0:1783137565.464217:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+33:10313:x1869754974369920:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2053us (2257us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1783137565.464226:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:1.0:1783137565.468644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.468765:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974370048 00000100:00100000:2.0:1783137565.468775:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974370048 00000100:00100000:2.0:1783137565.468856:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:2.0:1783137565.468866:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+33:10313:x1869754974370048:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:2.0:1783137565.468935:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.468950:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.468961:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.468986:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.468993:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.469017:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.469023:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137565.469027:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.469035:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.469047:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:2.0:1783137565.469050:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137565.469054:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.469060:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137565.469132:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+33:10313:x1869754974370048:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 266us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137565.469139:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:0.0:1783137565.471674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.471824:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974370304 00000100:00100000:2.0:1783137565.471833:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974370304 00000100:00100000:2.0:1783137565.471875:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:2.0:1783137565.471885:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+33:10313:x1869754974370304:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137565.472124:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:10313:x1869754974370304:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 240us (456us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1783137565.472132:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:1.0:1783137565.735890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.736015:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974370560 00000100:00100000:2.0:1783137565.736025:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974370560 00000100:00100000:2.0:1783137565.736075:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:2.0:1783137565.736084:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:10344:x1869754974370560:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:2.0:1783137565.736116:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137565.736134:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72831 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.736234:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.736246:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.736258:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137565.736269:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783137565.736403:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72831 expref: 37 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.736421:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72831 expref: 36 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.736429:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:2.0:1783137565.736432:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137565.736435:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051400, rc 0) 00000100:00100000:2.0:1783137565.736495:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:10344:x1869754974370560:12345-192.168.203.36@tcp:101:cat.0 Request processed in 412us (614us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1783137565.736519:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:1.0:1783137565.741471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137565.741525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137565.741591:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974370944 00000100:00100000:0.0:1783137565.741610:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974370944 00000100:00100000:0.0:1783137565.741670:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:0.0:1783137565.741688:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:2354:x1869754974370944:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137565.741703:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137565.741726:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72831 expref: 36 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137565.741742:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:0.0:1783137565.741747:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137565.741827:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:2354:x1869754974370944:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 140us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137565.741835:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:2.0:1783137565.742375:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974370816 00000100:00100000:2.0:1783137565.742380:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974370816 00000100:00100000:2.0:1783137565.742414:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:2.0:1783137565.742421:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:10344:x1869754974370816:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:2.0:1783137565.742596:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:10344:x1869754974370816:12345-192.168.203.36@tcp:35:cat.0 Request processed in 175us (1133us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1783137565.742601:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:1.0:1783137565.793488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.793573:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974371200 00000100:00100000:2.0:1783137565.793583:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974371200 00000100:00100000:2.0:1783137565.793641:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:2.0:1783137565.793651:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:10350:x1869754974371200:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1783137565.793672:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137565.793685:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783137565.793709:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674cae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72807 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.793726:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:2.0:1783137565.793730:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137565.793741:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72838 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.793871:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.793883:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7282a expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.793914:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.793944:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7282a expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.793955:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7282a expref: 36 pid: 5815 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137565.793968:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990131200:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137565.794049:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137565.796495:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990131200:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137565.796524:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137565.796641:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.797842:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974371328 00000100:00100000:2.0:1783137565.797853:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974371328 00010000:00010000:2.0:1783137565.797893:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7282a expref: 37 pid: 5815 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137565.798038:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:2.0:1783137565.798048:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:2352:x1869754974371328:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137565.798064:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137565.798071:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7282a expref: 37 pid: 5815 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.798206:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7282a expref: 37 pid: 5815 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.798229:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674d2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7282a expref: 37 pid: 5815 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.798244:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:2.0:1783137565.798250:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.798258:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.798265:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.798341:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137565.798405:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:2352:x1869754974371328:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 358us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137565.798412:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00010000:00010000:1.0:1783137565.799488:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.799498:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137565.799516:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783137565.799661:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674d56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72838 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.799693:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72838 expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137565.799702:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:1.0:1783137565.799705:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137565.799707:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051200, rc 0) 00000100:00100000:1.0:1783137565.799760:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:10350:x1869754974371200:12345-192.168.203.36@tcp:101:dd.0 Request processed in 6110us (6280us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1783137565.799768:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:1.0:1783137565.803454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137565.803536:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974371584 00000100:00100000:2.0:1783137565.803545:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974371584 00000100:00100000:2.0:1783137565.803623:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:2.0:1783137565.803634:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:10350:x1869754974371584:12345-192.168.203.36@tcp:36:dd.0 00010000:00010000:2.0:1783137565.804500:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.804518:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137565.804536:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137565.804592:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1783137565.804619:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1b54b06 reply state 000000002aa91cd0 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137565.804628:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137565.804726:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+39:10350:x1869754974371584:12345-192.168.203.36@tcp:36:dd.0 Request processed in 1092us (1279us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1783137565.804735:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00000020:00080000:2.0:1783137565.804741:0:7113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783137565.810362:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.810404:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.810412:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.810418:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137565.810424:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.810431:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.810448:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:3.0:1783137565.810451:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137565.810455:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137565.810461:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674d6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137566.004559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137566.004662:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974371712 00000100:00100000:0.0:1783137566.004671:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974371712 00000100:00080000:2.0:1783137566.004832:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137566.004881:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:1.0:1783137566.004893:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+38:10364:x1869754974371712:12345-192.168.203.36@tcp:101:stat.0 00010000:00010000:1.0:1783137566.004923:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137566.004940:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674d72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7283f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.004999:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005013:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005023:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005037:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005059:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005066:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005156:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005176:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72838 expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005185:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005216:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72838 expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.005228:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72838 expref: 39 pid: 5816 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137566.005241:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd855180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990131328:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137566.005333:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137566.006133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137566.006166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137566.006223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137566.006320:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974372096 00000100:00100000:2.0:1783137566.006328:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974372096 00000100:00100000:2.0:1783137566.006389:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:2.0:1783137566.006399:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974372096:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137566.006453:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974372096:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 55us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137566.006460:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:0.0:1783137566.006992:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974371840 00000100:00100000:0.0:1783137566.006996:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974371840 00000100:00100000:0.0:1783137566.007037:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 284 00000100:00100000:0.0:1783137566.007045:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974371840:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137566.007082:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974371840:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 39us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137566.007089:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 284 00000100:00080000:1.0:1783137566.008094:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137566.011074:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974371968 00000100:00100000:3.0:1783137566.011087:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974371968 00000100:00100000:3.0:1783137566.011311:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:3.0:1783137566.011323:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2351:x1869754974371968:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137566.011410:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2351:x1869754974371968:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 89us (5185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137566.011418:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:3.0:1783137566.011561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.011619:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd855180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990131328:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137566.011644:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137566.011677:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974372352 00000100:00100000:3.0:1783137566.011681:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974372352 00000100:00100000:3.0:1783137566.011704:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:3.0:1783137566.011711:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+40:9953:x1869754974372352:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783137566.013483:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+41:9953:x1869754974372352:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 1763us (1913us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1783137566.013495:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:3.0:1783137566.017124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137566.017274:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974372480 00000100:00100000:0.0:1783137566.017284:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974372480 00010000:00010000:0.0:1783137566.017322:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72838 expref: 41 pid: 5816 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137566.017364:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:0.0:1783137566.017375:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+41:2352:x1869754974372480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137566.017413:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137566.017420:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72838 expref: 41 pid: 5816 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.017434:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72838 expref: 41 pid: 5816 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.017456:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674d5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72838 expref: 41 pid: 5816 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.017473:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:0.0:1783137566.017478:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.017488:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.017496:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.017533:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137566.017578:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+40:2352:x1869754974372480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 205us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137566.017586:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 39 00010000:00010000:1.0:1783137566.017967:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.017983:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137566.018028:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783137566.018032:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137566.018086:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018110:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018120:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018126:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018133:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018138:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137566.018141:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018148:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018158:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:1.0:1783137566.018162:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137566.018165:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018189:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674d79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018200:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018205:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018210:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018214:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0cc00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137566.018217:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018221:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018229:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970990e51200) 00010000:00010000:1.0:1783137566.018231:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137566.018234:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018238:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674d80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018275:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674d72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7283f expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018289:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7283f expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.018302:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:1.0:1783137566.018305:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137566.018307:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d800, rc 0) 00000100:00100000:1.0:1783137566.018349:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+39:10364:x1869754974371712:12345-192.168.203.36@tcp:101:stat.0 Request processed in 13460us (13798us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137566.018358:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00080000:2.0:1783137566.019623:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783137566.096114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137566.096214:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974372736 00000100:00100000:0.0:1783137566.096223:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974372736 00000100:00100000:0.0:1783137566.096274:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:0.0:1783137566.096283:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+39:10370:x1869754974372736:12345-192.168.203.36@tcp:36:truncate.0 00010000:00010000:0.0:1783137566.096350:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137566.096373:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674d87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7283f expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.096401:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:0.0:1783137566.096405:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137566.096584:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.096597:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.096607:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137566.096645:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1783137566.096664:0:5814:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091d33de6 reply state 00000000f5204c7c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137566.096672:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137566.097113:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+41:10370:x1869754974372736:12345-192.168.203.36@tcp:36:truncate.0 Request processed in 828us (1005us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1783137566.097120:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00000020:00080000:0.0:1783137566.097125:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783137566.099016:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.099032:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.099040:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.099046:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137566.099050:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.099058:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.099072:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:1.0:1783137566.099075:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137566.099079:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.099084:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac674d8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.183150:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137566.280279:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137566.280889:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974372864 00000100:00100000:0.0:1783137566.280908:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974372864 00000100:00100000:0.0:1783137566.281021:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:0.0:1783137566.281031:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+40:10384:x1869754974372864:12345-192.168.203.36@tcp:101:stat.0 00010000:00010000:0.0:1783137566.281068:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137566.281086:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674d95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72846 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281157:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281179:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281191:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281204:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281210:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281218:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281305:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281312:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281319:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137566.281351:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1783137566.281361:0:7113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137566.281509:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281522:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281530:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281536:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281543:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281549:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137566.281553:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281560:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281573:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137566.281576:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137566.281580:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281586:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674d9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281598:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281615:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281620:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281626:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137566.281629:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281635:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281642:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9709860f4400) 00010000:00010000:0.0:1783137566.281645:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137566.281647:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281652:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674da3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281682:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674d95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72846 expref: 42 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281693:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72846 expref: 41 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.281700:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:0.0:1783137566.281702:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137566.281710:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235e00, rc 0) 00000100:00100000:0.0:1783137566.281784:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+41:10384:x1869754974372864:12345-192.168.203.36@tcp:101:stat.0 Request processed in 753us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137566.281891:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:0.0:1783137566.404710:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.404829:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974373120 00000100:00100000:3.0:1783137566.404848:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974373120 00000100:00100000:3.0:1783137566.404917:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:3.0:1783137566.404927:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+41:10394:x1869754974373120:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137566.404947:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137566.404967:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7284d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137566.405073:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783137566.405193:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674db1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7284d expref: 43 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.405206:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:3.0:1783137566.405209:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137566.405225:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7284d expref: 43 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.405239:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004000, rc 0) 00000100:00100000:3.0:1783137566.405294:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+42:10394:x1869754974373120:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 368us (594us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1783137566.405300:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:2.0:1783137566.408300:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.408603:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974373376 00000100:00100000:3.0:1783137566.408613:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974373376 00000100:00100000:3.0:1783137566.408668:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1783137566.408678:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+42:10394:x1869754974373376:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1783137566.408971:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+43:10394:x1869754974373376:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 293us (677us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1783137566.408980:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:2.0:1783137566.467657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137566.467788:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974373632 00000100:00100000:1.0:1783137566.467833:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974373632 00000100:00100000:1.0:1783137566.467997:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:1.0:1783137566.468008:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+43:10400:x1869754974373632:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1783137566.468032:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137566.468050:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674dbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72854 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.468146:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.468162:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72846 expref: 44 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.468181:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.468214:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72846 expref: 44 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.468227:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72846 expref: 44 pid: 7113 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137566.468241:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990131456:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137566.468356:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea780 going to sleep for 11 seconds 00000100:00100000:3.0:1783137566.471059:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990131456:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137566.471086:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137566.474226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.474701:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974373760 00000100:00100000:3.0:1783137566.474710:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974373760 00010000:00010000:3.0:1783137566.474749:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72846 expref: 45 pid: 7113 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137566.474821:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:3.0:1783137566.474831:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+45:2351:x1869754974373760:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137566.474856:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137566.474862:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72846 expref: 45 pid: 7113 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.474889:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72846 expref: 45 pid: 7113 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.474909:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac674daa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72846 expref: 45 pid: 7113 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.474929:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:3.0:1783137566.474935:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.474944:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.474951:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.474981:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137566.475082:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.475101:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137566.475118:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1783137566.475271:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674dbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72854 expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.475285:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72854 expref: 45 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.475293:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:1.0:1783137566.475296:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137566.475299:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c800, rc 0) 00000100:00100000:3.0:1783137566.475563:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+45:2351:x1869754974373760:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 732us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137566.475572:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:1.0:1783137566.475845:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+44:10400:x1869754974373632:12345-192.168.203.36@tcp:101:bash.0 Request processed in 7829us (8185us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1783137566.475852:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:2.0:1783137566.480738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137566.481324:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974374016 00000100:00100000:1.0:1783137566.481333:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974374016 00000100:00100000:1.0:1783137566.481385:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:1.0:1783137566.481396:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+44:10400:x1869754974374016:12345-192.168.203.36@tcp:36:bash.0 00010000:00010000:1.0:1783137566.481708:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.481725:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137566.481736:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783137566.481890:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1783137566.481922:0:5815:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005157fb7f reply state 00000000bb9b5ad9 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137566.481931:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783137566.482074:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:10400:x1869754974374016:12345-192.168.203.36@tcp:36:bash.0 Request processed in 678us (1343us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1783137566.482084:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 58 00000020:00080000:1.0:1783137566.482089:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783137566.485597:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.485614:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.485622:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.485646:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137566.485651:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.485658:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.486079:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:3.0:1783137566.486083:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137566.486088:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.486095:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674dd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137566.492772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137566.492923:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974374144 00000100:00100000:0.0:1783137566.492935:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974374144 00000100:00100000:0.0:1783137566.492996:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:0.0:1783137566.493008:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+46:10400:x1869754974374144:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137566.493031:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137566.493053:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674ddb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7285b expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.493134:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.493149:0:7113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72854 expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.493157:0:7113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.493210:0:7113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72854 expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.493223:0:7113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72854 expref: 47 pid: 5816 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137566.493235:0:7113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990131584:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137566.493325:0:7113:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab2906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137566.495614:0:7113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990131584:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137566.495655:0:7113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137566.499089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137566.499448:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974374272 00000100:00100000:0.0:1783137566.499458:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974374272 00010000:00010000:0.0:1783137566.499496:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72854 expref: 48 pid: 5816 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137566.499531:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:0.0:1783137566.499539:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:2352:x1869754974374272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137566.499551:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137566.499557:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72854 expref: 48 pid: 5816 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.499569:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72854 expref: 48 pid: 5816 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.499587:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674dc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72854 expref: 48 pid: 5816 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.499601:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:0.0:1783137566.499606:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.499614:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.499620:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.499646:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137566.499709:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:2352:x1869754974374272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 170us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137566.499716:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00010000:00010000:2.0:1783137566.499888:0:7113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.499899:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137566.499941:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783137566.499945:0:7113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137566.499964:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.499993:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674ddb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7285b expref: 47 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.500007:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7285b expref: 46 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.500014:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:2.0:1783137566.500016:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137566.500018:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234a00, rc 0) 00000100:00100000:2.0:1783137566.500055:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+46:10400:x1869754974374144:12345-192.168.203.36@tcp:101:bash.0 Request processed in 7051us (7293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137566.500062:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:2.0:1783137566.505455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.505560:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974374528 00000100:00100000:3.0:1783137566.505569:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974374528 00000100:00100000:3.0:1783137566.505670:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:3.0:1783137566.505681:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+46:10400:x1869754974374528:12345-192.168.203.36@tcp:35:bash.0 00000100:00100000:2.0:1783137566.506594:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:10400:x1869754974374528:12345-192.168.203.36@tcp:35:bash.0 Request processed in 911us (1143us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1783137566.506616:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:0.0:1783137566.585724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.585850:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974374784 00000100:00100000:3.0:1783137566.585860:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974374784 00000100:00100000:3.0:1783137566.586087:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:3.0:1783137566.586104:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:10410:x1869754974374784:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137566.586130:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137566.586150:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674de9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72862 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137566.586271:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783137566.587283:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674de9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72862 expref: 49 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.587302:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:3.0:1783137566.587305:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137566.587639:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674de9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72862 expref: 49 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.587656:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004000, rc 0) 00000100:00100000:3.0:1783137566.587773:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:10410:x1869754974374784:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1675us (2056us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1783137566.587782:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:1.0:1783137566.591110:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.591197:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974374912 00000100:00100000:3.0:1783137566.591207:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974374912 00000100:00100000:3.0:1783137566.591266:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:3.0:1783137566.591277:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:10410:x1869754974374912:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:3.0:1783137566.591350:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591366:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591376:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591390:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591397:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591416:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591510:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591519:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591527:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137566.591566:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591579:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591585:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591592:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591597:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137566.591601:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591609:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591620:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:3.0:1783137566.591630:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137566.591635:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591641:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674df7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591655:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591661:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591667:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591672:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137566.591675:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591681:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591688:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970987960600) 00010000:00010000:3.0:1783137566.591690:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137566.591693:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591698:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674dfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591712:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591724:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591729:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591735:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137566.591738:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591743:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591751:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:3.0:1783137566.591753:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137566.591755:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.591761:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137566.591954:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:10410:x1869754974374912:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 678us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137566.591963:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:2.0:1783137566.594260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137566.594343:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974375168 00000100:00100000:0.0:1783137566.594352:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974375168 00000100:00100000:0.0:1783137566.594410:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:0.0:1783137566.594420:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:10410:x1869754974375168:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137566.594657:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+49:10410:x1869754974375168:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 237us (405us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1783137566.594665:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:1.0:1783137566.625938:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137566.626075:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974375424 00000100:00100000:2.0:1783137566.626085:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974375424 00000100:00100000:2.0:1783137566.626139:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:2.0:1783137566.626149:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+49:10413:x1869754974375424:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137566.626181:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137566.626202:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674e0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72869 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626272:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626285:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626294:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626307:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626314:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626321:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626452:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626472:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626480:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137566.626491:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783137566.626606:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626614:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626620:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626625:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137566.626629:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626636:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626648:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:2.0:1783137566.626651:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137566.626654:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626660:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626673:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626685:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626690:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626695:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137566.626698:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626703:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626711:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970990e98800) 00010000:00010000:2.0:1783137566.626713:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137566.626716:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626721:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626758:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674e0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72869 expref: 52 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626772:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72869 expref: 51 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.626780:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:2.0:1783137566.626782:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137566.626840:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050400, rc 0) 00000100:00100000:2.0:1783137566.627022:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:10413:x1869754974375424:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 873us (1091us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1783137566.627031:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:1.0:1783137566.630138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137566.630230:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974375552 00000100:00100000:2.0:1783137566.630239:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974375552 00000100:00100000:2.0:1783137566.630327:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:2.0:1783137566.630336:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:10413:x1869754974375552:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:2.0:1783137566.630409:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.630425:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.630436:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.630462:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.630470:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.630477:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.630482:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137566.630486:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.630493:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.630517:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:2.0:1783137566.630520:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137566.630525:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.630530:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac674e2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137566.630599:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:10413:x1869754974375552:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 264us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137566.630607:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:1.0:1783137566.634181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137566.634294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137566.634355:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974375936 00000100:00100000:2.0:1783137566.634365:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974375936 00000100:00100000:2.0:1783137566.634429:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:2.0:1783137566.634440:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:2353:x1869754974375936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137566.634453:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137566.634477:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72869 expref: 51 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.634495:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:2.0:1783137566.634500:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137566.634553:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:2353:x1869754974375936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 115us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137566.634562:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:0.0:1783137566.636018:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974375808 00000100:00100000:0.0:1783137566.636030:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974375808 00000100:00100000:0.0:1783137566.636116:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:0.0:1783137566.636125:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:10413:x1869754974375808:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137566.636350:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:10413:x1869754974375808:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 226us (2258us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783137566.636358:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:1.0:1783137566.805592:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.805700:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974376192 00000100:00100000:3.0:1783137566.805709:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974376192 00000100:00100000:3.0:1783137566.805776:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:3.0:1783137566.805786:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:10431:x1869754974376192:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1783137566.805855:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137566.805888:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72870 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.805993:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.806007:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.806017:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137566.806039:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783137566.806189:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72870 expref: 54 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.806206:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72870 expref: 53 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.806214:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:3.0:1783137566.806217:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783137566.806220:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005800, rc 0) 00000100:00100000:3.0:1783137566.806278:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10431:x1869754974376192:12345-192.168.203.36@tcp:101:cat.0 Request processed in 494us (697us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1783137566.806285:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:1.0:1783137566.839553:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.839774:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974376320 00000100:00100000:3.0:1783137566.839783:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974376320 00000100:00100000:3.0:1783137566.839878:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:3.0:1783137566.839889:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10432:x1869754974376320:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137566.839931:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137566.839950:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72877 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.840020:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674e52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.840034:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.840045:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137566.840203:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783137566.840207:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137566.840232:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.840256:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72877 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.840272:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72877 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.840279:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:3.0:1783137566.840282:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137566.840284:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004600, rc 0) 00000100:00100000:3.0:1783137566.840341:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10432:x1869754974376320:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 455us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137566.840348:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:1.0:1783137566.850960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137566.852767:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974376704 00000100:00100000:2.0:1783137566.852781:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974376704 00000100:00100000:2.0:1783137566.852972:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:2.0:1783137566.852997:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10432:x1869754974376704:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137566.853329:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10432:x1869754974376704:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 333us (2377us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1783137566.853336:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:1.0:1783137566.858308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137566.858426:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974376832 00000100:00100000:0.0:1783137566.858436:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974376832 00000100:00100000:0.0:1783137566.858548:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:0.0:1783137566.858559:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10432:x1869754974376832:12345-192.168.203.36@tcp:103:lfs.0 00010000:00010000:0.0:1783137566.858574:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783137566.858597:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac674de2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7285b expref: 55 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.858640:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72870 expref: 54 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.858654:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674ced lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7281c expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137566.858664:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960e00) 00010000:00010000:0.0:1783137566.858675:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137566.858730:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:10432:x1869754974376832:12345-192.168.203.36@tcp:103:lfs.0 Request processed in 172us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137566.858738:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:1.0:1783137566.868319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137566.868814:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974376960 00000100:00100000:2.0:1783137566.868824:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974376960 00000100:00100000:2.0:1783137566.868884:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:2.0:1783137566.868903:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:10432:x1869754974376960:12345-192.168.203.36@tcp:58:lfs.0 00010000:00010000:2.0:1783137566.869018:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.869034:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137566.869046:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783137566.869330:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137566.869539:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1783137566.869611:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1783137566.869712:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:10432:x1869754974376960:12345-192.168.203.36@tcp:58:lfs.0 Request processed in 817us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137566.869720:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:1.0:1783137566.895249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137566.895909:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974377088 00000100:00100000:3.0:1783137566.895920:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974377088 00000100:00100000:3.0:1783137566.895980:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:3.0:1783137566.895990:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:10434:x1869754974377088:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137566.896008:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137566.896028:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7287e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896090:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896113:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896124:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896139:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896146:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896152:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896248:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896256:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896278:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137566.896314:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783137566.896318:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137566.896336:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896347:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896355:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896361:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896367:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896372:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137566.896376:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896383:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896395:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:3.0:1783137566.896398:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137566.896402:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896419:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896432:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896438:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896443:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896447:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137566.896450:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896455:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896463:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970987960600) 00010000:00010000:3.0:1783137566.896465:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137566.896468:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896474:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896504:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7287e expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896517:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7287e expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137566.896531:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:3.0:1783137566.896533:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137566.896536:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005800, rc 0) 00000100:00100000:3.0:1783137566.896626:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10434:x1869754974377088:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 637us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137566.896633:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 67 00000040:00080000:1.0:1783137567.080987:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783137567.080996:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783137567.081051:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783137567.081059:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783137567.081185:0:11579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990131712:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783137567.081275:0:11579:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783137567.091067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137567.091209:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974377216 00000100:00100000:0.0:1783137567.091217:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974377216 00000100:00100000:0.0:1783137567.091271:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:0.0:1783137567.091281:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10445:x1869754974377216:12345-192.168.203.36@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783137567.091352:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10445:x1869754974377216:12345-192.168.203.36@tcp:900:lhsmtool_posix.0 Request processed in 72us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137567.091359:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:3.0:1783137567.103177:0:11579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990131712:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783137567.103349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.111224:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974377344 00000100:00100000:3.0:1783137567.111237:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974377344 00000100:00100000:3.0:1783137567.111302:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:3.0:1783137567.111312:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10445:x1869754974377344:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783137567.111341:0:5815:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783137567.111437:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10445:x1869754974377344:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 126us (8088us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137567.111446:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:2.0:1783137567.121886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.122446:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974377472 00000100:00100000:3.0:1783137567.122456:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974377472 00000100:00100000:3.0:1783137567.122516:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:3.0:1783137567.122527:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10445:x1869754974377472:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783137567.122589:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122605:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122632:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122672:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122679:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122686:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122711:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122718:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122724:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137567.122759:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783137567.122763:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137567.122774:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122784:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122811:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122829:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122834:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137567.122838:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122845:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122856:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:3.0:1783137567.122860:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137567.122864:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122870:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac674e7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122883:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122889:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122908:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122913:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137567.122916:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122933:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122942:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff970987960600) 00010000:00010000:3.0:1783137567.122945:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137567.122948:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122954:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac674e83 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122969:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122975:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122981:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122986:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137567.122989:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.122994:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.123000:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:3.0:1783137567.123003:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137567.123006:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.123021:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac674e8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137567.123091:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10445:x1869754974377472:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 Request processed in 565us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137567.123110:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:3.0:1783137567.125741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137567.125843:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974377728 00000100:00100000:2.0:1783137567.125853:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974377728 00000100:00100000:2.0:1783137567.125911:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:2.0:1783137567.125920:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10445:x1869754974377728:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137567.125952:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137567.125971:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72885 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126061:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126075:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126086:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137567.126096:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783137567.126198:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126206:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126213:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126218:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137567.126222:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126229:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126242:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:2.0:1783137567.126252:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137567.126258:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126264:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674e98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126307:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e91 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72885 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126317:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:2.0:1783137567.126319:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137567.126323:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674e91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72885 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.126332:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051800, rc 0) 00000100:00100000:2.0:1783137567.126400:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10445:x1869754974377728:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 481us (667us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1783137567.126407:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:3.0:1783137567.129852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137567.130190:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974377856 00000100:00100000:0.0:1783137567.130200:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974377856 00000100:00100000:0.0:1783137567.130326:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:0.0:1783137567.130337:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10445:x1869754974377856:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783137567.130372:0:5816:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783137567.130484:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10445:x1869754974377856:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 149us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137567.130508:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:2.0:1783137567.135024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.135185:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974378112 00000100:00100000:3.0:1783137567.135196:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974378112 00000100:00100000:3.0:1783137567.135286:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:3.0:1783137567.135297:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10445:x1869754974378112:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137567.135317:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137567.135320:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783137567.135344:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac674e52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72877 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.135360:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:3.0:1783137567.135365:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137567.135389:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674ea6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7288c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783137567.135836:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1783137567.136055:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac674ead lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.136068:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac674ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.136086:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac674ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.136150:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac674ea6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7288c expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.136179:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac674ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7288c expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.136186:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970987960500) 00010000:00010000:3.0:1783137567.136189:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137567.136192:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005a00, rc 0) 00000100:00100000:3.0:1783137567.136256:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10445:x1869754974378112:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 961us (1242us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1783137567.136265:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:0.0:1783137567.142205:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.142324:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974378368 00000100:00100000:3.0:1783137567.142334:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974378368 00000100:00100000:3.0:1783137567.142400:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:3.0:1783137567.142411:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10445:x1869754974378368:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783137567.142466:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137567.142492:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac674ead lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7288c expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142508:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970987960500) 00010000:00010000:3.0:1783137567.142519:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137567.142539:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142567:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142577:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142594:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142602:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142610:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142685:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142693:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142700:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142706:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137567.142711:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142718:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142728:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:3.0:1783137567.142736:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137567.142741:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142748:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac674ebb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142758:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142764:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142770:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142774:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137567.142777:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142783:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142816:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x164f6674 (ffff970987960300) 00010000:00010000:3.0:1783137567.142819:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137567.142822:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.142828:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674ec2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x164f6674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137567.142914:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10445:x1869754974378368:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 505us (715us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783137567.142928:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:2.0:1783137567.146354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.149610:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974378496 00000100:00100000:1.0:1783137567.149625:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974378496 00000100:00100000:1.0:1783137567.149726:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:1.0:1783137567.149738:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10445:x1869754974378496:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137567.149758:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137567.149809:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ec9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72893 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.149846:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.149860:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.149873:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.149980:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ec9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72893 expref: 56 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.149997:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72893 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.150006:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:1.0:1783137567.150010:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783137567.150014:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c000, rc 0) 00000100:00100000:1.0:1783137567.150085:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10445:x1869754974378496:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 349us (3738us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137567.150105:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:3.0:1783137567.155054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.155283:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974378752 00000100:00100000:1.0:1783137567.155293:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974378752 00000100:00100000:1.0:1783137567.155336:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:1.0:1783137567.155345:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10445:x1869754974378752:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783137567.155424:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.155439:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.155450:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783137567.155695:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1783137567.155705:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323052912372ns, next at 324052910155ns, rc = 0 00000004:00010000:1.0:1783137567.155787:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f0306bf reply state 00000000057e1755 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137567.155829:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783137567.155917:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:10445:x1869754974378752:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 572us (875us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1783137567.155926:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 75 00010000:00010000:1.0:1783137567.162125:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.162142:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.162174:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.162180:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0cc00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137567.162185:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.162192:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.162206:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:1.0:1783137567.162209:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783137567.162213:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.162219:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674ed7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137567.162331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.167447:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974378880 00000100:00100000:1.0:1783137567.167461:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974378880 00000100:00100000:1.0:1783137567.167524:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:1.0:1783137567.167534:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10445:x1869754974378880:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137567.167555:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137567.167588:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7289a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.167645:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7289a expref: 57 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.167677:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7289a expref: 57 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.167698:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:1.0:1783137567.167701:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137567.167705:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c200, rc 0) 00000100:00100000:1.0:1783137567.167773:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:10445:x1869754974378880:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 239us (5446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137567.167780:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:1.0:1783137567.175665:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.176500:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974379008 00000100:00100000:3.0:1783137567.176511:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974379008 00000100:00100000:3.0:1783137567.176555:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:3.0:1783137567.176564:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1869754974379008:12345-192.168.203.36@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1783137567.176595:0:6618:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1783137567.176625:0:6618:0:(genops.c:1406:class_connect()) connect: client d717cef4-1367-4dd9-ae68-a0c1ee666834, cookie 0x88def104ac674ee5 00002000:00100000:3.0:1783137567.176637:0:6618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d717cef4-1367-4dd9-ae68-a0c1ee666834/ffff97098534c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783137567.176660:0:6618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783137567.176926:0:6618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783137567.176956:0:6618:0:(import.c:65:import_set_state_nolock()) ffff97098534e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137567.177017:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2350:x1869754974379008:12345-192.168.203.36@tcp:8:lhsmtool_posix.0 Request processed in 452us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137567.177025:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:2.0:1783137567.184404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.184532:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974379136 00000100:00100000:3.0:1783137567.184541:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974379136 00000100:00100000:3.0:1783137567.184608:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:3.0:1783137567.184618:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:0:x1869754974379136:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1783137567.185304:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783137567.207506:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137567.248765:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:0:x1869754974379136:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 64138us (64358us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783137567.248780:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 25 00000001:00080000:0.0:1783137567.248916:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1783137567.248925:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000100:00100000:2.0:1783137567.256079:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137567.256193:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974379392 00000100:00100000:0.0:1783137567.256216:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974379392 00000100:00100000:0.0:1783137567.256314:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:0.0:1783137567.256325:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:10445:x1869754974379392:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783137567.256885:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:10445:x1869754974379392:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 560us (828us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783137567.256909:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:1.0:1783137567.264493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.264606:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974379648 00000100:00100000:3.0:1783137567.264627:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974379648 00000100:00100000:3.0:1783137567.264685:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:3.0:1783137567.264695:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:10445:x1869754974379648:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783137567.264816:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:10445:x1869754974379648:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 121us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137567.264825:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:3.0:1783137567.275915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.276714:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974379776 00000100:00100000:1.0:1783137567.276726:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974379776 00000100:00100000:1.0:1783137567.276826:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:1.0:1783137567.276838:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:10445:x1869754974379776:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137567.276860:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137567.276882:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674eec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728a1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.276962:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ef3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.276976:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.276988:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137567.277045:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137567.277063:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.277088:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674eec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a1 expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.277105:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a1 expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.277115:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:1.0:1783137567.277118:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783137567.277122:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c800, rc 0) 00000100:00100000:1.0:1783137567.277193:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:10445:x1869754974379776:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 357us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137567.277200:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:0.0:1783137567.283241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.283319:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974379904 00000100:00100000:3.0:1783137567.283329:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974379904 00000100:00100000:3.0:1783137567.283385:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:3.0:1783137567.283395:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2353:x1869754974379904:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137567.283414:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137567.283433:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728a8 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137567.283459:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a48851e, blocks: 0x1 00010000:00010000:3.0:1783137567.283478:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1783137567.283482:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137567.283492:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a8 expref: 6 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.283511:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a8 expref: 6 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.283524:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005c00, rc 0) 00000100:00100000:3.0:1783137567.283582:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2353:x1869754974379904:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 188us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137567.283602:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:0.0:1783137567.289734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.289830:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974380160 00000100:00100000:3.0:1783137567.289840:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974380160 00000100:00100000:3.0:1783137567.289908:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:3.0:1783137567.289918:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:10445:x1869754974380160:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783137567.290022:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:10445:x1869754974380160:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 106us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137567.290030:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:1.0:1783137567.293034:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137567.293344:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974380288 00000100:00100000:0.0:1783137567.293550:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974380288 00000100:00100000:0.0:1783137567.293650:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:0.0:1783137567.293662:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:10445:x1869754974380288:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137567.293679:0:6620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137567.293695:0:6620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728af expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.293725:0:6620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a8 expref: 7 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.293733:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137567.293749:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137567.293755:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 7 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.293786:0:6620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a8 expref: 7 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.293837:0:6620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a8 expref: 7 pid: 6618 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137567.293852:0:6620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6620:1869754990131840:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137567.293950:0:6620:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137567.303651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137567.303693:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974380416 00000100:00100000:0.0:1783137567.303701:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974380416 00010000:00010000:0.0:1783137567.303754:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a8 expref: 8 pid: 6618 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137567.303817:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:0.0:1783137567.303828:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974380416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137567.303843:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137567.303864:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a8 expref: 8 pid: 6618 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.303879:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a8 expref: 8 pid: 6618 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.303933:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137567.303938:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137567.303948:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 8 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.303959:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 8 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.303996:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 8 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137567.304011:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5801:1869754990131968:192.168.203.36@tcp:105: 00000100:00100000:0.0:1783137567.304092:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b32840 going to sleep for 11 seconds 00010000:00010000:0.0:1783137567.305020:0:6620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2a59917/0x88def104ac674efa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a8 expref: 8 pid: 6618 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137567.305038:0:6620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6620:1869754990131840:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137567.305064:0:6620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 7 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.305076:0:6620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235a00, rc 0) 00000100:00100000:0.0:1783137567.305335:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:10445:x1869754974380288:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 11674us (12307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137567.305344:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:0.0:1783137567.310189:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.310257:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974380544 00000100:00100000:3.0:1783137567.310266:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974380544 00002000:00100000:3.0:1783137567.310313:0:6626:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9709bd6db480 x1869754974380544/t0(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:473/0 lens 504/0 e 0 to 0 dl 1783137578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783137567.310324:0:6626:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd6db480 with x1869754974380544 ext(0->8) 00002000:00010000:3.0:1783137567.310330:0:6626:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709bd6db480 00000100:00100000:3.0:1783137567.310362:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:3.0:1783137567.310381:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974380544:12345-192.168.203.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783137567.311004:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2352:x1869754974380544:12345-192.168.203.36@tcp:4:lhsmtool_posix.0 Request processed in 632us (822us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783137567.311014:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00002000:00100000:3.0:1783137567.311021:0:6626:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9709bd6db480 x1869754974380544/t4294967302(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:473/0 lens 504/448 e 0 to 0 dl 1783137578 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783137567.311030:0:6626:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd6db480 with x1869754974380544 ext(0->8) 00002000:00010000:3.0:1783137567.311034:0:6626:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709bd6db480 00000100:00100000:1.0:1783137567.312156:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5801:1869754990131968:192.168.203.36@tcp:105: 00010000:00010000:1.0:1783137567.312188:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137567.312233:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974380416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 8407us (8591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137567.312243:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:0.0:1783137567.318335:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.318410:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974380672 00000100:00100000:1.0:1783137567.318420:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974380672 00000100:00100000:1.0:1783137567.318476:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:1.0:1783137567.318486:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:10445:x1869754974380672:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783137567.362712:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1783137567.362734:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1783137567.362781:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1783137567.362819:0:5836:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff970997f57300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1783137567.362824:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9709887fac00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff970997f57600 00000020:00080000:1.0:1783137567.362827:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9709887fa500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97098535d400 00000020:00080000:1.0:1783137567.363046:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1783137567.363539:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:10445:x1869754974380672:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 Request processed in 45050us (45207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137567.363549:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 80 00000020:00080000:1.0:1783137567.365577:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1783137567.365602:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990132096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783137567.365662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137567.365701:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137567.365708:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990132224:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783137567.365729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137567.365767:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990132096 00000100:00100000:1.0:1783137567.365775:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990132096 00000100:00100000:1.0:1783137567.365839:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990132224 00000100:00100000:1.0:1783137567.365843:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990132224 00000100:00100000:1.0:1783137567.365866:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783137567.365873:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990132096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783137567.366036:0:6618:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783137567.366039:0:6618:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783137566 00002000:00010000:1.0:1783137567.366042:0:6618:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783137567.366044:0:6618:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783137566 -> 1783137566 00002000:00010000:1.0:1783137567.366046:0:6618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783137567.366086:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1869754990132096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 212us (422us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783137567.366105:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783137567.366123:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783137567.366130:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1869754990132224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783137567.366145:0:6618:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1783137567.366184:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a48851c, atime: 0x6a48851c, ctime: 0x6a48851c, blocks: 0x1 00010000:00010000:1.0:1783137567.366193:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.366208:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1783137567.366213:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137567.366219:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.366237:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.366247:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.366255:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.366272:0:6618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783137567.367151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.367788:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1869754990132224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1656us (2055us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783137567.367875:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974380800 00000100:00100000:0.0:1783137567.367882:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974380800 00000100:00100000:0.0:1783137567.367928:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:0.0:1783137567.367936:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974380800:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1783137567.367986:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137567.367990:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137567.368210:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1783137567.368243:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137567.368249:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.368261:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0ce00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137567.368265:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.368276:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.368293:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.368300:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2ba3587/0x88def104ac674f08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.368319:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137567.368321:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137567.368322:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783137567.368353:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709b7eb3b80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1783137567.368359:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990132224:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783137567.368383:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709b7eb1880/2, rc 0, transno 4294967303 00000100:00100000:1.0:1783137567.368387:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990132096:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1783137567.424008:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1783137567.424024:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1783137567.424211:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974380800:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 Request processed in 56269us (57057us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137567.424223:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:2.0:1783137567.428246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.428870:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974381056 00000100:00100000:3.0:1783137567.428882:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974381056 00000100:00100000:3.0:1783137567.429007:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:3.0:1783137567.429018:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:10445:x1869754974381056:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783137567.429069:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137567.429094:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674ef3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728a1 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.429113:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:3.0:1783137567.429118:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137567.429144:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.429169:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.429180:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137567.429432:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbecfb4d reply state 00000000269e0da3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137567.429441:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137567.429538:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:10445:x1869754974381056:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 521us (1301us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1783137567.429546:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 81 00010000:00010000:2.0:1783137567.432045:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.432066:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.432073:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.432079:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137567.432084:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.432091:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.432107:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:2.0:1783137567.432110:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137567.432115:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.432120:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac674f0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137567.432992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137567.433257:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974381184 00000100:00100000:3.0:1783137567.433267:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974381184 00000100:00100000:3.0:1783137567.433323:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:3.0:1783137567.433333:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974381184:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783137567.433566:0:6619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1783137567.433570:0:6619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783137566 -> 1783137566 00002000:00010000:3.0:1783137567.433572:0:6619:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783137564 00002000:00010000:3.0:1783137567.433574:0:6619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783137566 -> 1783137566 00002000:00010000:3.0:1783137567.433577:0:6619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783137567.433633:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974381184:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 301us (646us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783137567.433641:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:3.0:1783137567.435727:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137567.435826:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974381440 00000100:00100000:2.0:1783137567.435839:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974381440 00000100:00100000:2.0:1783137567.435940:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:2.0:1783137567.435952:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:10445:x1869754974381440:12345-192.168.203.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783137567.436026:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.436046:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72893 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.436088:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.436121:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72893 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.436134:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72893 expref: 13 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137567.436149:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990132352:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137567.436246:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137567.439680:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990132352:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137567.439707:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137567.440867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137567.440932:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974381568 00000100:00100000:0.0:1783137567.440939:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974381568 00010000:00010000:0.0:1783137567.440989:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72893 expref: 14 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137567.441022:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1783137567.441031:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:2354:x1869754974381568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137567.441045:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137567.441051:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72893 expref: 14 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441075:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72893 expref: 14 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441095:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674ed0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72893 expref: 14 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441116:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:0.0:1783137567.441121:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441129:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441137:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441170:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137567.441223:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2354:x1869754974381568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 192us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137567.441231:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 43 00010000:00010000:0.0:1783137567.441255:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441263:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441290:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441296:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441302:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441308:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137567.441318:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441327:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441335:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:0.0:1783137567.441338:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783137567.441342:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.441347:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137567.441386:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+12:10445:x1869754974381440:12345-192.168.203.36@tcp:55:lhsmtool_posix.0 Request processed in 5437us (5667us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783137567.441394:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:0.0:1783137567.447446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137567.447521:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974381696 00000100:00100000:2.0:1783137567.447529:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974381696 00000100:00100000:2.0:1783137567.447582:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:2.0:1783137567.447591:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974381696:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783137567.447631:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.447651:0:6620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 7 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.447660:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137567.447671:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137567.447675:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.447709:0:6620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 7 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.447723:0:6620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 7 pid: 6620 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137567.447737:0:6620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6620:1869754990132480:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137567.447834:0:6620:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137567.450069:0:6620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6620:1869754990132480:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137567.450092:0:6620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137567.453775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.453931:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974381824 00000100:00100000:1.0:1783137567.453940:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974381824 00010000:00010000:1.0:1783137567.454045:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 8 pid: 6620 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137567.454252:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:1.0:1783137567.454263:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974381824:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137567.454276:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137567.454296:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 8 pid: 6620 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.454310:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 8 pid: 6620 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.454345:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ce18651/0x88def104ac674f01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728af expref: 8 pid: 6620 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.454359:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137567.454363:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137567.454368:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.454377:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.454410:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137567.454442:0:6620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.454452:0:6620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.454474:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.454482:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.454502:0:6620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.454508:0:6620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137567.454512:0:6620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137567.454521:0:6620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137567.454526:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2351:x1869754974381824:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 265us (760us total) trans 0 rc 0/0 00010000:00010000:3.0:1783137567.454533:0:6620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137567.454534:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 44 00010000:00010000:3.0:1783137567.454540:0:6620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac674f1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137567.454589:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974381696:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 Request processed in 6999us (7151us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137567.454596:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:3.0:1783137567.459060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137567.459271:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974382080 00000100:00100000:2.0:1783137567.459280:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974382080 00000100:00100000:2.0:1783137567.459365:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:2.0:1783137567.459384:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+12:10445:x1869754974382080:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783137567.459454:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.459607:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.459620:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.459872:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.459884:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7289a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.459892:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.459924:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7289a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.459937:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7289a expref: 13 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137567.459950:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990132608:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137567.460020:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137567.464324:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990132608:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137567.464470:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137567.465544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.465853:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974382208 00000100:00100000:1.0:1783137567.465860:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974382208 00010000:00010000:1.0:1783137567.465898:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7289a expref: 14 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137567.465933:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:1.0:1783137567.465942:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:2352:x1869754974382208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137567.465956:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137567.465962:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7289a expref: 14 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.465974:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7289a expref: 14 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.465994:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac674ede lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7289a expref: 14 pid: 5815 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.466010:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:1.0:1783137567.466015:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.466024:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.466032:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.466051:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137567.466099:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2352:x1869754974382208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 157us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137567.466120:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 45 00010000:00010000:2.0:1783137567.466226:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.466234:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137567.466569:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1783137567.466711:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1783137567.466752:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1783137567.467869:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1869754990132736:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783137567.467928:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137567.467958:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137567.468098:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990132736 00000100:00100000:1.0:1783137567.468106:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990132736 00000100:00100000:1.0:1783137567.468154:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783137567.468173:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1869754990132736:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783137567.468240:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1869754990132736:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137567.468247:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137567.468314:0:5816:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1783137567.468320:0:5816:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709b7eb1880, transno 4294967303 00000100:00100000:2.0:1783137567.468581:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1869754990132736:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783137567.469077:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1783137567.469143:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1869754990132864:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783137567.469199:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137567.469230:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099cf6e780 going to sleep for 11 seconds 00000100:00100000:3.0:1783137567.470220:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990132864 00000100:00100000:3.0:1783137567.470228:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990132864 00000100:00100000:3.0:1783137567.470273:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783137567.470282:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1869754990132864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783137567.471350:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1869754990132864:12345-0@lo:1000:mdt00_002.0 Request processed in 1065us (2146us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783137567.471361:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137567.472591:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1869754990132864:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783137567.472636:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472647:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472653:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472660:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137567.472665:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472672:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472687:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff970990e51200) 00010000:00010000:2.0:1783137567.472696:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137567.472701:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472708:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472742:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472750:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472755:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472759:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137567.472762:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472767:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472776:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:2.0:1783137567.472778:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137567.472781:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472786:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac674e59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472824:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472846:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7287e expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472855:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472885:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7287e expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.472898:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7287e expref: 16 pid: 5816 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137567.472912:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990132992:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137567.472984:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137567.483918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137567.483957:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974382336 00000100:00100000:2.0:1783137567.483966:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974382336 00000100:00100000:1.0:1783137567.484118:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf236300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990132992:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137567.484140:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.485306:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7287e expref: 17 pid: 5816 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137567.485354:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:2.0:1783137567.485368:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:2351:x1869754974382336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137567.485381:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137567.485389:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7287e expref: 17 pid: 5816 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.485401:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7287e expref: 17 pid: 5816 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.485750:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac674e75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7287e expref: 17 pid: 5816 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.485837:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:2.0:1783137567.485843:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.485854:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.485862:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.485890:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137567.485924:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.485934:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.485948:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486022:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486030:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486045:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137567.486049:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486056:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486067:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:0.0:1783137567.486069:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137567.486073:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486079:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac674f32 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486091:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486097:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486102:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486107:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137567.486110:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486115:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486134:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98800) 00010000:00010000:0.0:1783137567.486136:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783137567.486140:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.486146:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac674f24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137567.486268:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:2351:x1869754974382336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 903us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137567.486278:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:0.0:1783137567.486370:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:10445:x1869754974382080:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 26987us (27317us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1783137567.486379:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 83 00000020:00080000:0.0:1783137567.486383:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783137567.486748:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137567.486754:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137567.486881:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783137567.486888:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137567.489044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137567.489203:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974382592 00000100:00100000:0.0:1783137567.489212:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974382592 00000100:00100000:0.0:1783137567.489268:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1783137567.489278:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:10445:x1869754974382592:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783137567.489949:0:5817:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783137567.490063:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1783137567.490107:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.490123:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.490134:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.490142:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.490171:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.490177:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137567.490199:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783137567.490280:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:10445:x1869754974382592:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 1002us (1245us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1783137567.490288:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000020:00080000:0.0:1783137567.490293:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783137567.491536:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137567.491546:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.491556:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137567.491560:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.491583:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.491597:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9709860f4a00) 00010000:00010000:2.0:1783137567.491610:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783137567.491615:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.491621:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac674f39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.491640:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137567.491642:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137567.491644:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137567.777149:0:11895:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137567.777167:0:11895:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137567.777201:0:11895:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783137567.777207:0:11895:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137567.903730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137567.903766:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974382848 00000100:00100000:2.0:1783137567.903774:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974382848 00000100:00100000:2.0:1783137567.904191:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:2.0:1783137567.904203:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:10455:x1869754974382848:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137567.904228:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137567.904247:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728b6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.906818:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674f47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.906841:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674f47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.906853:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674f47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137567.906877:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1783137567.907122:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728b6 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.907140:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674f47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728b6 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.907148:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:2.0:1783137567.907151:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783137567.907170:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051800, rc 0) 00000100:00100000:2.0:1783137567.907240:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:10455:x1869754974382848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3039us (3519us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1783137567.907248:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:3.0:1783137567.916133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137567.916185:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974382976 00000100:00100000:2.0:1783137567.916196:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974382976 00000100:00100000:2.0:1783137567.916251:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:2.0:1783137567.916262:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:10455:x1869754974382976:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:2.0:1783137567.916343:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.916360:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.916372:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.916632:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.916650:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.916657:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917021:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917030:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917036:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137567.917083:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917093:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917098:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917102:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917106:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137567.917108:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917112:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917127:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:2.0:1783137567.917129:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137567.917132:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917136:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674f55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917143:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917147:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917150:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917165:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137567.917168:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917177:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917185:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970990e98f00) 00010000:00010000:2.0:1783137567.917187:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137567.917190:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917195:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917220:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917227:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917232:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917237:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137567.917240:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917245:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917253:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e98200) 00010000:00010000:2.0:1783137567.917255:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137567.917258:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137567.917263:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137567.917346:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:10455:x1869754974382976:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 1083us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137567.917355:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:3.0:1783137567.960181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.960417:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974383232 00000100:00100000:1.0:1783137567.960426:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974383232 00000100:00100000:1.0:1783137567.960479:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:1.0:1783137567.960489:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:10458:x1869754974383232:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1783137567.960508:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137567.960526:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674f6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.960606:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.960620:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.960632:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.960660:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.960668:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.960675:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961239:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961250:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961258:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137567.961269:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1783137567.961475:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961484:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961491:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961497:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137567.961501:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961519:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961541:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:1.0:1783137567.961544:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137567.961549:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961556:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674f71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961568:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961574:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961580:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961586:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137567.961589:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961595:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961603:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970990e51900) 00010000:00010000:1.0:1783137567.961605:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137567.961608:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961623:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674f78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961668:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac674f6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728bd expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961682:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728bd expref: 21 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.961690:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:1.0:1783137567.961691:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137567.961694:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0cc00, rc 0) 00000100:00100000:1.0:1783137567.961759:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:10458:x1869754974383232:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1271us (1588us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1783137567.961767:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:0.0:1783137567.965955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137567.966098:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974383360 00000100:00100000:1.0:1783137567.966108:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974383360 00000100:00100000:1.0:1783137567.966164:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:1.0:1783137567.966175:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:10458:x1869754974383360:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:1.0:1783137567.966237:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.966253:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.966265:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.966317:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.966324:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.966331:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.966337:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137567.966341:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.966357:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.966376:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:1.0:1783137567.966380:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783137567.966384:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137567.966391:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac674f8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137567.966461:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:10458:x1869754974383360:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 288us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137567.966470:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:3.0:1783137567.968469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137567.968697:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974383616 00000100:00100000:2.0:1783137567.968707:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974383616 00000100:00100000:2.0:1783137567.968763:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:2.0:1783137567.968784:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:10458:x1869754974383616:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137567.969048:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+22:10458:x1869754974383616:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 264us (585us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1783137567.969056:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:3.0:1783137568.010652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.010738:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974383872 00000100:00100000:2.0:1783137568.010747:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974383872 00000100:00100000:2.0:1783137568.010828:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:2.0:1783137568.010838:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+22:9987:x1869754974383872:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1783137568.010861:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137568.010880:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728c4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.010967:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.010980:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728bd expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.010989:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.011018:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728bd expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.011031:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728bd expref: 23 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137568.011045:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990133120:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137568.011162:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ce5f480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137568.016713:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf235500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990133120:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137568.016740:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.016942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137568.017018:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974384000 00000100:00100000:1.0:1783137568.017025:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974384000 00010000:00010000:1.0:1783137568.017058:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728bd expref: 24 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.017105:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:1.0:1783137568.017114:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:2352:x1869754974384000:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137568.017128:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137568.017134:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728bd expref: 24 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.017145:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728bd expref: 24 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.017174:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674f7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728bd expref: 24 pid: 5814 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.017188:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:1.0:1783137568.017193:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.017201:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.017208:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.017233:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137568.017279:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:2352:x1869754974384000:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 166us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137568.017287:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00010000:00010000:2.0:1783137568.017495:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.017503:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137568.017520:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783137568.017660:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674f94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728c4 expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.017675:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728c4 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.017682:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:2.0:1783137568.017684:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783137568.017686:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051000, rc 0) 00000100:00100000:2.0:1783137568.017726:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:9987:x1869754974383872:12345-192.168.203.36@tcp:101:bash.0 Request processed in 6890us (7083us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1783137568.017734:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00080000:0.0:1783137568.018285:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137568.020443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.020589:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974384256 00000100:00100000:2.0:1783137568.020599:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974384256 00000100:00100000:2.0:1783137568.020653:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:2.0:1783137568.020663:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:9987:x1869754974384256:12345-192.168.203.36@tcp:36:bash.0 00010000:00010000:2.0:1783137568.020956:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.020971:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.020982:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137568.021032:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1783137568.021056:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043668eea reply state 000000009a3adb98 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137568.021064:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783137568.021104:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1783137568.021207:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:9987:x1869754974384256:12345-192.168.203.36@tcp:36:bash.0 Request processed in 544us (770us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1783137568.021214:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 89 00000020:00080000:2.0:1783137568.021220:0:7113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1783137568.023361:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.023375:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.023382:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.023389:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.023394:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.023418:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.023433:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:2.0:1783137568.023436:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.023440:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.023446:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fa9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.025879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.025974:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974384384 00000100:00100000:0.0:1783137568.025984:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974384384 00000100:00100000:0.0:1783137568.026051:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:0.0:1783137568.026063:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:9987:x1869754974384384:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137568.026087:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.026112:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac674fb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.026178:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac674fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728cb expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.026229:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac674fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728cb expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.026253:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:0.0:1783137568.026256:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137568.026260:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235000, rc 0) 00000100:00100000:0.0:1783137568.026317:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:9987:x1869754974384384:12345-192.168.203.36@tcp:101:bash.0 Request processed in 257us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137568.026325:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:1.0:1783137568.030968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137568.033254:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974384512 00000100:00100000:3.0:1783137568.033270:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974384512 00000100:00100000:3.0:1783137568.033372:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:3.0:1783137568.033384:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:9987:x1869754974384512:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:3.0:1783137568.033401:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137568.033423:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728d2 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137568.033447:0:6619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a48851e, atime: 0x6a48851c, ctime: 0x6a48851e, blocks: 0xb 00010000:00010000:3.0:1783137568.033467:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1783137568.033472:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137568.033479:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d2 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.033494:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d2 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.033520:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005a00, rc 0) 00000100:00100000:3.0:1783137568.033597:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:9987:x1869754974384512:12345-192.168.203.36@tcp:101:bash.0 Request processed in 216us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.033604:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:1.0:1783137568.039419:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137568.042710:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974384640 00000100:00100000:3.0:1783137568.042724:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974384640 00002000:00010000:3.0:1783137568.042770:0:6624:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1783137568.042775:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709b7eb1c00 with x1869754974384640 ext(0->18446744073709551615) 00002000:00010000:3.0:1783137568.042787:0:6624:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709b7eb1c00. 00000100:00100000:3.0:1783137568.043180:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:3.0:1783137568.043190:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2351:x1869754974384640:12345-192.168.203.36@tcp:10:bash.0 00002000:00010000:3.0:1783137568.043850:0:6624:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783137568.043854:0:6624:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783137566 -> 1783137567 00002000:00010000:3.0:1783137568.043857:0:6624:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1783137564 -> 1783137564 00002000:00010000:3.0:1783137568.043859:0:6624:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783137566 -> 1783137567 00002000:00010000:3.0:1783137568.043861:0:6624:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1783137568.043983:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974384640:12345-192.168.203.36@tcp:10:bash.0 Request processed in 792us (4572us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783137568.043992:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1 00002000:00010000:3.0:1783137568.043997:0:6624:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1783137568.044000:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709b7eb1c00 with x1869754974384640 ext(0->18446744073709551615) 00002000:00010000:3.0:1783137568.044006:0:6624:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709b7eb1c00. 00000100:00100000:0.0:1783137568.115006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.115185:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974384768 00000100:00100000:2.0:1783137568.115194:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974384768 00000100:00100000:2.0:1783137568.115575:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:2.0:1783137568.115587:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:10472:x1869754974384768:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:2.0:1783137568.115657:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.115674:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.115687:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.115702:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.115710:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.115717:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.116035:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.116045:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.116053:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137568.116090:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117461:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117485:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117493:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117499:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.117503:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117510:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117526:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:2.0:1783137568.117529:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.117534:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117556:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac674fbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117572:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117578:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117584:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117589:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.117593:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117599:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117608:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970990e98200) 00010000:00010000:2.0:1783137568.117611:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.117613:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117618:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac674fc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117635:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117641:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117652:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117657:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.117660:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117666:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117675:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:2.0:1783137568.117677:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.117680:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.117686:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac674fcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137568.117877:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:10472:x1869754974384768:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 2288us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137568.117888:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:0.0:1783137568.155494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.155728:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974385024 00000100:00100000:2.0:1783137568.155738:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974385024 00000100:00100000:1.0:1783137568.156022:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:1.0:1783137568.156034:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:10475:x1869754974385024:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1783137568.156052:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137568.156071:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674fd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728d9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.156141:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.156164:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.156175:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.156189:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.156195:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.156202:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.156664:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674fe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.156674:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.156683:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137568.156700:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783137568.158545:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158565:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158573:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158581:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137568.158585:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158594:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158609:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:1.0:1783137568.158612:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137568.158617:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158624:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac674fda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158642:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158648:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158672:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158677:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137568.158680:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158687:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158696:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970990e51900) 00010000:00010000:1.0:1783137568.158698:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137568.158702:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.158707:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac674fe1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.159049:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac674fd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d9 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.159066:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d9 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.159073:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:1.0:1783137568.159076:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783137568.159078:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c000, rc 0) 00000100:00100000:1.0:1783137568.159167:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:10475:x1869754974385024:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 3121us (3668us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1783137568.159185:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:3.0:1783137568.161695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.162842:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974385152 00000100:00100000:0.0:1783137568.162852:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974385152 00000100:00100000:0.0:1783137568.162914:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:0.0:1783137568.162926:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:10475:x1869754974385152:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:0.0:1783137568.162990:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.163005:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728c4 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.163015:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.163048:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728c4 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.163080:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728c4 expref: 29 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.163095:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990133248:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137568.163193:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b32540 going to sleep for 11 seconds 00000100:00100000:0.0:1783137568.165269:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990133248:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137568.165295:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.166090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.166183:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974385408 00000100:00100000:2.0:1783137568.166191:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974385408 00000100:00100000:2.0:1783137568.166234:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:2.0:1783137568.166287:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:9953:x1869754974385408:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783137568.166588:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:9953:x1869754974385408:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 340us (497us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783137568.166609:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:3.0:1783137568.172031:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.172125:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974385536 00000100:00100000:0.0:1783137568.172135:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974385536 00010000:00010000:0.0:1783137568.172187:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728c4 expref: 31 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.172230:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:0.0:1783137568.172241:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:2351:x1869754974385536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137568.172255:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137568.172263:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728c4 expref: 31 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.172277:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728c4 expref: 31 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.172299:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac674f9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728c4 expref: 31 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.172326:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:0.0:1783137568.172332:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.172341:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.172350:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.172385:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137568.172456:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:2351:x1869754974385536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 216us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137568.172465:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 48 00010000:00010000:1.0:1783137568.172682:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.172691:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.172721:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.172728:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.172735:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.172741:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137568.172746:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.172753:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.172763:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:1.0:1783137568.172766:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783137568.172770:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.172777:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac674ff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.172868:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:10475:x1869754974385152:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 9944us (11180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137568.172877:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:1.0:1783137568.176254:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.176561:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974385792 00000100:00100000:2.0:1783137568.176646:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974385792 00000100:00100000:2.0:1783137568.176701:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1783137568.176713:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:10475:x1869754974385792:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137568.177249:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:10475:x1869754974385792:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 536us (1002us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1783137568.177257:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00010000:00010000:3.0:1783137568.231030:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137568.249321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.249431:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974386048 00000100:00100000:0.0:1783137568.249441:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974386048 00000100:00100000:0.0:1783137568.249502:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:0.0:1783137568.249512:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:10486:x1869754974386048:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1783137568.249537:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.249557:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674ffd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728e0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.249636:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.249651:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.249662:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.249692:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.249700:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.249707:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250059:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675012 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250070:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250077:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137568.250087:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1783137568.250190:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250199:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250205:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250212:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137568.250216:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250235:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250248:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137568.250251:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137568.250256:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250262:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675004 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250275:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250280:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250285:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250289:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137568.250291:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250297:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250303:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9709860f4400) 00010000:00010000:0.0:1783137568.250305:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137568.250308:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250322:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67500b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250365:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac674ffd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e0 expref: 33 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250378:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e0 expref: 32 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.250384:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:0.0:1783137568.250386:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137568.250389:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234a00, rc 0) 00000100:00100000:0.0:1783137568.250468:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:10486:x1869754974386048:12345-192.168.203.36@tcp:101:cat.0 Request processed in 957us (1156us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1783137568.250476:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:2.0:1783137568.256383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.256510:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974386304 00000100:00100000:0.0:1783137568.256521:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974386304 00000100:00100000:0.0:1783137568.256690:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:0.0:1783137568.256701:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:10486:x1869754974386304:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1783137568.257001:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+33:10486:x1869754974386304:12345-192.168.203.36@tcp:35:cat.0 Request processed in 301us (638us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1783137568.257009:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:2.0:1783137568.276512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137568.276755:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974386560 00000100:00100000:3.0:1783137568.276765:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974386560 00000100:00100000:3.0:1783137568.276843:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:3.0:1783137568.276853:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+33:10487:x1869754974386560:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:3.0:1783137568.276969:0:7113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783137568.276996:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e0 expref: 33 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277016:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac674fe8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d9 expref: 32 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277029:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac674fb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728cb expref: 31 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277040:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970990e51f00) 00010000:00010000:3.0:1783137568.277050:0:7113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137568.277069:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277082:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277091:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277170:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277193:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277200:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277842:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277853:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.277860:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137568.279077:0:7113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1783137568.279087:0:7113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324176294659ns, next at 325176292737ns, rc = 0 00010000:00010000:3.0:1783137568.279237:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279249:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279258:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279266:0:7113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279272:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279289:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279352:0:7113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137568.279380:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279387:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279393:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279398:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137568.279402:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279409:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279419:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960c00) 00010000:00010000:3.0:1783137568.279422:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783137568.279425:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279431:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67502e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279446:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279452:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279463:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279468:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137568.279471:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279476:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279483:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:3.0:1783137568.279485:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137568.279487:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.279492:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675020 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137568.279501:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ef1197f reply state 0000000020ac7d24 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.279509:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137568.279673:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:10487:x1869754974386560:12345-192.168.203.36@tcp:36:rm.0 Request processed in 2819us (3166us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1783137568.279681:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 95 00010000:00010000:1.0:1783137568.280259:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137568.280267:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.280274:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137568.280278:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.280284:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.280295:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff970987960c00) 00010000:00010000:1.0:1783137568.280297:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783137568.280300:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.280306:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675035 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.280321:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137568.280323:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137568.280324:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137568.282420:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.282436:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.282442:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.282447:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.282451:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.282458:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.282470:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970987960600) 00010000:00010000:2.0:1783137568.282473:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.282489:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.282495:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675027 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137568.321206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.322570:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974386816 00000100:00100000:0.0:1783137568.322580:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974386816 00000100:00100000:0.0:1783137568.322675:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:0.0:1783137568.322683:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:10493:x1869754974386816:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137568.322714:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.322731:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67503c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728e7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.322881:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.322896:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.322906:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.322920:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.322927:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.322935:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137568.323706:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1783137568.323905:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.323916:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.323925:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.323970:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.323977:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.323983:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.323988:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137568.323993:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.324000:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.324012:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137568.324015:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137568.324020:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.324026:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675043 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137568.324039:0:5814:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad28ab05 reply state 00000000f7896fef transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.324048:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783137568.324078:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67503c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e7 expref: 34 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.324104:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e7 expref: 33 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.324112:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9709860f4c00) 00010000:00010000:0.0:1783137568.324114:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137568.324117:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235c00, rc 0) 00000100:00100000:0.0:1783137568.326511:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:10493:x1869754974386816:12345-192.168.203.36@tcp:101:bash.0 Request processed in 3819us (5303us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1783137568.326525:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 96 00010000:00010000:1.0:1783137568.330342:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.330358:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.330385:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.330391:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137568.330396:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.330403:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.330419:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9709860f4400) 00010000:00010000:1.0:1783137568.330423:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137568.330428:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.330434:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67504a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137568.331097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137568.333125:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974386944 00000100:00100000:3.0:1783137568.333140:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974386944 00000100:00100000:3.0:1783137568.333270:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:3.0:1783137568.333281:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2353:x1869754974386944:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:3.0:1783137568.333322:0:8200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137568.333342:0:8200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728ee expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137568.334383:0:8200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137568.334407:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1783137568.334412:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137568.334424:0:8200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728ee expref: 8 pid: 8200 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.334445:0:8200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728ee expref: 8 pid: 8200 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.334457:0:8200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004600, rc 0) 00000100:00100000:3.0:1783137568.334524:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2353:x1869754974386944:12345-192.168.203.36@tcp:101:bash.0 Request processed in 1245us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.334532:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1783137568.337608:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137568.337687:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974387072 00000100:00100000:1.0:1783137568.337696:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974387072 00000100:00100000:1.0:1783137568.337748:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:1.0:1783137568.337757:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:10493:x1869754974387072:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1783137568.337774:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137568.337817:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728f5 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.337849:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728ee expref: 9 pid: 8200 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.337877:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137568.337880:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137568.337886:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 9 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.337945:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728ee expref: 9 pid: 8200 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.337959:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728ee expref: 9 pid: 8200 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.337973:0:6618:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd08a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6618:1869754990133376:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137568.338049:0:6618:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bc952a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137568.341293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.342233:0:6618:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd08a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6618:1869754990133376:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137568.342268:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 9 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.342288:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d000, rc 0) 00000100:00100000:2.0:1783137568.342357:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:10493:x1869754974387072:12345-192.168.203.36@tcp:101:bash.0 Request processed in 4600us (4756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137568.342373:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00080000:0.0:1783137568.342486:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783137568.347431:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974387200 00000100:00100000:3.0:1783137568.347447:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974387200 00010000:00010000:3.0:1783137568.347495:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728ee expref: 9 pid: 8200 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.347540:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:3.0:1783137568.347550:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2351:x1869754974387200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137568.347577:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137568.347610:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728ee expref: 9 pid: 8200 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.347623:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728ee expref: 9 pid: 8200 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.347643:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac67505f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728ee expref: 9 pid: 8200 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.347658:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137568.347662:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137568.347669:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 8 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.347679:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 8 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.347714:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 8 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.347727:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1869754990133504:192.168.203.36@tcp:105: 00000100:00100000:3.0:1783137568.347839:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709b784f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137568.353051:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1869754990133504:192.168.203.36@tcp:105: 00010000:00010000:3.0:1783137568.353078:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137568.353134:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974387200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5585us (11850us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.353171:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:2.0:1783137568.355045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.355132:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974387456 00000100:00100000:0.0:1783137568.355140:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974387456 00000100:00100000:0.0:1783137568.355202:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:0.0:1783137568.355212:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+33:10493:x1869754974387456:12345-192.168.203.36@tcp:35:bash.0 00000001:00080000:0.0:1783137568.355497:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967377 00000100:00100000:0.0:1783137568.355611:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:10493:x1869754974387456:12345-192.168.203.36@tcp:35:bash.0 Request processed in 400us (572us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1783137568.355620:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 25 00000020:00080000:0.0:1783137568.355624:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783137568.505280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.505390:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974387584 00000100:00100000:0.0:1783137568.505399:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974387584 00000100:00100000:0.0:1783137568.505457:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:0.0:1783137568.505467:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:10509:x1869754974387584:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137568.505494:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.505513:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67506d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec728fc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.505594:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675074 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.505608:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675074 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.505619:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675074 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137568.505676:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783137568.505680:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137568.505704:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675074 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.505729:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67506d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728fc expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.505747:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675074 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728fc expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.505756:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137568.505758:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137568.505762:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234c00, rc 0) 00000100:00100000:0.0:1783137568.505861:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:10509:x1869754974387584:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 396us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137568.505869:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:1.0:1783137568.512004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.512099:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974387840 00000100:00100000:0.0:1783137568.512110:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974387840 00000100:00100000:0.0:1783137568.512191:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:0.0:1783137568.512202:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:10509:x1869754974387840:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137568.512223:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.512243:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67507b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72903 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.512335:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675082 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.512349:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.512361:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137568.512384:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783137568.512507:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67507b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72903 expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.512526:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675082 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72903 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.512534:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9709860f4c00) 00010000:00010000:0.0:1783137568.512537:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137568.512541:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235800, rc 0) 00000100:00100000:0.0:1783137568.512603:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+38:10509:x1869754974387840:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 403us (614us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1783137568.512610:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:1.0:1783137568.522977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137568.523063:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.523248:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974388224 00000100:00100000:2.0:1783137568.523258:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974388224 00000100:00100000:2.0:1783137568.523322:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:2.0:1783137568.523332:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+38:2352:x1869754974388224:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137568.523349:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137568.523372:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675082 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72903 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.523390:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9709860f4c00) 00010000:00010000:2.0:1783137568.523395:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137568.523575:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:2352:x1869754974388224:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 244us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137568.523584:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:0.0:1783137568.524550:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974388096 00000100:00100000:0.0:1783137568.524608:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974388096 00000100:00100000:0.0:1783137568.524688:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:0.0:1783137568.524696:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:10509:x1869754974388096:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137568.524716:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.524731:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675090 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7290a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.524842:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675097 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.524856:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.524867:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137568.524880:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783137568.525010:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675090 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7290a expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.525026:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7290a expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.525035:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9709860f4c00) 00010000:00010000:0.0:1783137568.525038:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783137568.525042:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234600, rc 0) 00000100:00100000:0.0:1783137568.525087:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+39:10509:x1869754974388096:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 392us (2121us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1783137568.525095:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:1.0:1783137568.532762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137568.533737:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974388352 00000100:00100000:3.0:1783137568.533749:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974388352 00000100:00100000:3.0:1783137568.533874:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:3.0:1783137568.533884:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1af4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974388352:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:3.0:1783137568.533928:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.533950:0:6620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 8 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.533958:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137568.533962:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783137568.533966:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.534024:0:6620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 8 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.534037:0:6620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 8 pid: 6618 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.534052:0:6620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6620:1869754990133632:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137568.534145:0:6620:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709b784f840 going to sleep for 11 seconds 00000100:00100000:3.0:1783137568.536671:0:6620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6620:1869754990133632:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137568.536707:0:6620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.537408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.537595:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974388480 00000100:00100000:0.0:1783137568.537603:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974388480 00002000:00100000:0.0:1783137568.537640:0:6625:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9709bd08ad80 x1869754974388480/t0(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:474/0 lens 504/0 e 0 to 0 dl 1783137579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137568.537649:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd08ad80 with x1869754974388480 ext(0->8) 00010000:00010000:0.0:1783137568.537657:0:6625:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 9 pid: 6618 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.537670:0:6625:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 9 pid: 6618 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783137568.537677:0:6625:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9709bd08ad80 00000100:00100000:0.0:1783137568.537708:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:0.0:1783137568.537716:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2351:x1869754974388480:12345-192.168.203.36@tcp:4:lfs.0 00000100:00100000:0.0:1783137568.540769:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:2351:x1869754974388480:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 1294us (1612us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783137568.540784:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1 00002000:00100000:0.0:1783137568.540834:0:6625:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9709bd08ad80 x1869754974388480/t4294967302(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:474/0 lens 504/448 e 0 to 0 dl 1783137579 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137568.540844:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd08ad80 with x1869754974388480 ext(0->8) 00010000:00010000:0.0:1783137568.540853:0:6625:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 11 pid: 6618 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.540873:0:6625:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 11 pid: 6618 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783137568.540910:0:6625:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9709bd08ad80 00000100:00100000:2.0:1783137568.542240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137568.543673:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974388608 00000100:00100000:1.0:1783137568.543685:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974388608 00010000:00010000:1.0:1783137568.543725:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 11 pid: 6618 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.543872:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:1.0:1783137568.543885:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:2353:x1869754974388608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137568.543900:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783137568.543917:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783137568.543920:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783137568 00002000:00010000:1.0:1783137568.543922:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783137568 00002000:00010000:1.0:1783137568.543924:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783137568 00010000:00010000:1.0:1783137568.543930:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 11 pid: 6618 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.543944:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 11 pid: 6618 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.543966:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062722678/0x88def104ac675066 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728f5 expref: 11 pid: 6618 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.543981:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137568.543985:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137568.543991:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.543999:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.544032:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137568.544065:0:6620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.544275:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:2353:x1869754974388608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 393us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137568.544283:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00010000:00010000:3.0:1783137568.544458:0:6620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.544483:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.544491:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.544499:0:6620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.544506:0:6620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137568.544510:0:6620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.544519:0:6620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.544530:0:6620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.544544:0:6620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca7ac855/0x88def104ac6750a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.544657:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1af4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2352:x1869754974388352:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 10775us (11904us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.544665:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:2.0:1783137568.547367:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.547439:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974388864 00000100:00100000:0.0:1783137568.547448:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974388864 00000100:00100000:0.0:1783137568.547667:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:0.0:1783137568.547676:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+39:10509:x1869754974388864:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:0.0:1783137568.547879:0:5817:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7290a expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137568.548666:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1783137568.548716:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1783137568.549622:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:0.0:1783137568.549684:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.549702:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e7 expref: 43 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.549711:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.549746:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e7 expref: 43 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.549761:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e7 expref: 43 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.549776:0:5817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6d9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1869754990133760:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137568.550227:0:5817:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137568.554110:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137568.554191:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974388992 00000100:00100000:3.0:1783137568.554200:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974388992 00010000:00010000:3.0:1783137568.554236:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e7 expref: 44 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.554275:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:3.0:1783137568.554285:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+44:2351:x1869754974388992:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137568.554307:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137568.554314:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e7 expref: 44 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.554326:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e7 expref: 44 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.554346:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9709860f4c00) 00010000:00010000:3.0:1783137568.554351:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.554371:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.554395:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.554423:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137568.554489:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+44:2351:x1869754974388992:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 204us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.554497:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00010000:00010000:0.0:1783137568.555881:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675051 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728e7 expref: 43 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.555913:0:5817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6d9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1869754990133760:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137568.555936:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.555945:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.555951:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137568.556066:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1783137568.556262:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1783137568.556384:0:5817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6d9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1869754990133888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783137568.556444:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137568.556489:0:5817:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b32600 going to sleep for 11 seconds 00000100:00100000:3.0:1783137568.556714:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990133888 00000100:00100000:3.0:1783137568.556721:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990133888 00000100:00100000:3.0:1783137568.556762:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783137568.556770:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1869754990133888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783137568.556872:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1869754990133888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.556880:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783137568.556987:0:5817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6d9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1869754990133888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783137568.557423:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1783137568.557486:0:5817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6d9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1869754990134016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783137568.557517:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137568.557543:0:5817:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137568.557817:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990134016 00000100:00100000:3.0:1783137568.557823:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990134016 00000100:00100000:3.0:1783137568.557846:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783137568.557853:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1869754990134016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783137568.557984:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5817:x1869754990134016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (465us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783137568.557990:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783137568.558193:0:5817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6d9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1869754990134016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783137568.558235:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1783137568.558270:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.558291:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.558299:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.558304:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137568.558308:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.558315:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.558329:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9709860f4c00) 00010000:00010000:0.0:1783137568.558332:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783137568.558337:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.558343:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783137568.559717:0:5817:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783137568.560004:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1783137568.560016:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324457224186ns, next at 325457221707ns, rc = 0 00000001:00080000:1.0:1783137568.560026:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1783137568.560074:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9709860f4c00) 00010000:00010000:1.0:1783137568.560078:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783137568.560087:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675097 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7290a expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.560252:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+46:10509:x1869754974388864:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 12575us (12891us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1783137568.560261:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00000020:00080000:1.0:1783137568.560267:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783137568.563662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.563746:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974389120 00000100:00100000:0.0:1783137568.563755:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974389120 00000100:00100000:2.0:1783137568.564041:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:2.0:1783137568.564053:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+46:10509:x1869754974389120:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137568.564077:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137568.564108:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6750b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72911 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.564175:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6750b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72911 expref: 47 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.564190:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6750b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72911 expref: 47 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.564209:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:2.0:1783137568.564212:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137568.564215:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051400, rc 0) 00000100:00100000:2.0:1783137568.564274:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:10509:x1869754974389120:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 224us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137568.564281:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:3.0:1783137568.567842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.567953:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974389376 00000100:00100000:0.0:1783137568.567962:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974389376 00000100:00100000:0.0:1783137568.568007:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:0.0:1783137568.568016:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:10509:x1869754974389376:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137568.568235:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:10509:x1869754974389376:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 219us (401us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1783137568.568257:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:3.0:1783137568.655086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.655291:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974389504 00000100:00100000:2.0:1783137568.655311:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974389504 00000100:00100000:2.0:1783137568.655379:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:2.0:1783137568.655389:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:10520:x1869754974389504:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:2.0:1783137568.655477:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655493:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655503:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655517:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655524:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655530:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655624:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655632:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655638:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137568.655678:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655690:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655708:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655715:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655720:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.655724:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655732:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655743:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:2.0:1783137568.655745:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.655749:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655754:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655767:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655772:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655777:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655781:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.655839:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655847:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655856:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970990e98f00) 00010000:00010000:2.0:1783137568.655859:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.655862:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655867:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655891:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655896:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655901:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655906:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.655908:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655914:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655921:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:2.0:1783137568.655924:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.655935:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.655940:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137568.656013:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:10520:x1869754974389504:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 625us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137568.656021:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:3.0:1783137568.681666:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990134528:0@lo:400:kworker.0 00000100:00100000:3.0:1783137568.681731:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137568.681814:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137568.681832:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990134400:0@lo:400:kworker.0 00000100:00100000:3.0:1783137568.681860:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137568.681892:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990134528 00000100:00100000:3.0:1783137568.681898:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990134528 00000100:00100000:3.0:1783137568.681936:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783137568.681945:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990134528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137568.681996:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990134528:12345-0@lo:400:kworker.0 Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.682003:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783137568.682040:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990134528:0@lo:400:kworker.0 00000100:00100000:3.0:1783137568.682064:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990134400 00000100:00100000:3.0:1783137568.682067:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990134400 00000100:00080000:3.0:1783137568.682087:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137568.682110:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783137568.682117:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990134400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137568.682162:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990134400:12345-0@lo:400:kworker.0 Request processed in 44us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.682168:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783137568.682191:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990134400:0@lo:400:kworker.0 00000100:00100000:2.0:1783137568.682268:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990134272:0@lo:400:kworker.0 00000100:00100000:2.0:1783137568.682299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137568.682335:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783137568.682341:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990134144:0@lo:400:kworker.0 00000100:00100000:2.0:1783137568.682379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137568.682405:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990134656:0@lo:400:kworker.0 00000100:00100000:2.0:1783137568.682423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137568.682446:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990134144 00000100:00100000:2.0:1783137568.682450:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990134144 00000100:00100000:2.0:1783137568.682477:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1783137568.682482:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990134144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137568.682516:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990134144:12345-0@lo:400:kworker.0 Request processed in 33us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137568.682521:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1783137568.682554:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990134144:0@lo:400:kworker.0 00000100:00100000:2.0:1783137568.682574:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990134272 00000100:00100000:2.0:1783137568.682577:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990134272 00000100:00100000:2.0:1783137568.682597:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990134656 00000100:00100000:2.0:1783137568.682600:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990134656 00000100:00080000:2.0:1783137568.682622:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137568.682631:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783137568.682637:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990134272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137568.682670:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990134272:12345-0@lo:400:kworker.0 Request processed in 33us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137568.682676:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783137568.682698:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990134272:0@lo:400:kworker.0 00000100:00100000:2.0:1783137568.682728:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783137568.682735:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990134656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137568.682766:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990134656:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137568.682771:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783137568.682815:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990134656:0@lo:400:kworker.0 00000100:00100000:3.0:1783137568.685190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.685627:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974389760 00000100:00100000:2.0:1783137568.685637:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974389760 00000100:00100000:2.0:1783137568.685698:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:2.0:1783137568.685708:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:10523:x1869754974389760:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137568.685725:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137568.685745:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72918 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.685852:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.685865:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.685904:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.685919:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.685927:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.685934:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686059:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686068:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686074:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137568.686083:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783137568.686198:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686206:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686212:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686218:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.686228:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686235:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686245:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:2.0:1783137568.686248:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.686251:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686256:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac6750d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686267:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686272:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686277:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686281:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137568.686283:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686287:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686292:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970990e98f00) 00010000:00010000:2.0:1783137568.686294:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137568.686630:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686637:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6750dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686679:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6750cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72918 expref: 51 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686693:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72918 expref: 50 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137568.686700:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:2.0:1783137568.686702:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137568.686705:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051000, rc 0) 00000100:00100000:2.0:1783137568.686770:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:10523:x1869754974389760:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1064us (1588us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1783137568.686778:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:3.0:1783137568.690027:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.690126:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974389888 00000100:00100000:0.0:1783137568.690135:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974389888 00000100:00100000:0.0:1783137568.690199:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:0.0:1783137568.690209:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:10523:x1869754974389888:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:0.0:1783137568.690271:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.690288:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.690309:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.690335:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.690342:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.690348:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.690354:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137568.690358:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.690377:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.690387:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:0.0:1783137568.690403:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137568.690408:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.690415:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.690489:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:10523:x1869754974389888:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 281us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137568.690497:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:3.0:1783137568.693916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.694061:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974390144 00000100:00100000:0.0:1783137568.694071:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974390144 00000100:00100000:0.0:1783137568.694117:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:0.0:1783137568.694126:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:10523:x1869754974390144:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137568.694486:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:10523:x1869754974390144:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 359us (576us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1783137568.694494:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:1.0:1783137568.760631:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.760817:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974390400 00000100:00100000:0.0:1783137568.760827:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974390400 00000100:00100000:0.0:1783137568.760892:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:0.0:1783137568.760903:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:10533:x1869754974390400:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137568.760929:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.760932:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783137568.760957:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675074 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728fc expref: 51 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.760975:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137568.760980:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137568.761004:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7291f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.761091:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.761104:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72918 expref: 51 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.761113:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.761142:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72918 expref: 51 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.761164:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72918 expref: 51 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.761176:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990134784:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137568.761261:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137568.764539:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137568.764633:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974390528 00000100:00100000:1.0:1783137568.764641:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974390528 00010000:00010000:1.0:1783137568.764678:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72918 expref: 52 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.764716:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:1.0:1783137568.764725:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:2352:x1869754974390528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137568.764738:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137568.764755:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72918 expref: 52 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.764766:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72918 expref: 52 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.764785:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:1.0:1783137568.764817:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.764825:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.764832:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.764849:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137568.764911:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:2352:x1869754974390528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 186us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137568.764919:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00010000:00010000:0.0:1783137568.765752:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6750e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72918 expref: 51 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.765770:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990134784:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137568.765815:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.765825:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.765846:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137568.765863:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783137568.766002:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6750f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7291f expref: 52 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.766016:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7291f expref: 51 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.766024:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:0.0:1783137568.766027:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783137568.766029:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235c00, rc 0) 00000100:00100000:0.0:1783137568.766157:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:10533:x1869754974390400:12345-192.168.203.36@tcp:101:bash.0 Request processed in 5248us (5527us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1783137568.766165:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 104 00000100:00100000:3.0:1783137568.769117:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.769239:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974390784 00000100:00100000:0.0:1783137568.769248:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974390784 00000100:00100000:0.0:1783137568.769302:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 105 00000100:00100000:0.0:1783137568.769311:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:10533:x1869754974390784:12345-192.168.203.36@tcp:36:bash.0 00010000:00010000:0.0:1783137568.769588:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.769603:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.769613:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137568.769673:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:0.0:1783137568.769695:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000020be676 reply state 0000000009c0b8f7 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.769703:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137568.769783:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10533:x1869754974390784:12345-192.168.203.36@tcp:36:bash.0 Request processed in 472us (684us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1783137568.769826:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 105 00000020:00080000:0.0:1783137568.769833:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783137568.773747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:0.0:1783137568.773846:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.773858:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.773866:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.773873:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137568.773877:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.773895:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.773912:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:0.0:1783137568.773915:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137568.773920:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.773927:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67510e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.774104:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974390912 00000100:00100000:1.0:1783137568.774113:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974390912 00000100:00100000:1.0:1783137568.774171:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 106 00000100:00100000:1.0:1783137568.774182:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10533:x1869754974390912:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1783137568.774203:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137568.774219:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675115 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72926 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.774296:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.774314:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7291f expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.774322:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.774354:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7291f expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.774375:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7291f expref: 54 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137568.774389:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd08b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990134912:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137568.774454:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bc952cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137568.779035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137568.779141:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd08b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990134912:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137568.779176:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.779399:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974391040 00000100:00100000:3.0:1783137568.779417:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974391040 00010000:00010000:3.0:1783137568.779447:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7291f expref: 55 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.779482:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:3.0:1783137568.779489:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:2351:x1869754974391040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137568.779502:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137568.779508:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7291f expref: 55 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.779519:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7291f expref: 55 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.779539:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675100 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7291f expref: 55 pid: 5815 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.779562:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:3.0:1783137568.779567:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.779576:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.779583:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.779608:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137568.779659:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:2351:x1869754974391040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 169us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.779675:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 53 00010000:00010000:1.0:1783137568.780026:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.780034:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137568.780079:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783137568.780083:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137568.780103:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.780158:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675115 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72926 expref: 54 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.780175:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72926 expref: 53 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.780182:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:1.0:1783137568.780185:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137568.780187:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d000, rc 0) 00000100:00100000:1.0:1783137568.780219:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10533:x1869754974390912:12345-192.168.203.36@tcp:101:bash.0 Request processed in 6040us (6482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137568.780226:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 106 00000100:00100000:2.0:1783137568.784202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137568.784272:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974391296 00000100:00100000:1.0:1783137568.784281:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974391296 00000100:00100000:1.0:1783137568.784330:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:1.0:1783137568.784339:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:10533:x1869754974391296:12345-192.168.203.36@tcp:35:bash.0 00000100:00100000:1.0:1783137568.784546:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10533:x1869754974391296:12345-192.168.203.36@tcp:35:bash.0 Request processed in 207us (352us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1783137568.784560:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:3.0:1783137568.842847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.842986:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974391424 00000100:00100000:0.0:1783137568.842995:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974391424 00000100:00100000:0.0:1783137568.843051:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:0.0:1783137568.843061:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:10539:x1869754974391424:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137568.843083:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.843113:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7292d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.843183:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67512a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.843196:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67512a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.843206:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67512a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137568.843260:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783137568.843264:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137568.843288:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67512a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.843312:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7292d expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.843329:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67512a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7292d expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.843337:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137568.843352:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137568.843356:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234c00, rc 0) 00000100:00100000:0.0:1783137568.843419:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10539:x1869754974391424:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 359us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137568.843426:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 107 00000100:00100000:3.0:1783137568.846127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.846228:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974391552 00000100:00100000:0.0:1783137568.846237:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974391552 00000100:00100000:0.0:1783137568.846287:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:0.0:1783137568.846298:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10539:x1869754974391552:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137568.846316:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.846334:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675131 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72934 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846392:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846406:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846416:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846430:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846437:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846443:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846552:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675146 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846561:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846568:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137568.846602:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783137568.846606:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137568.846622:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846633:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846641:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846648:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846654:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846660:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137568.846664:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846671:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846690:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137568.846693:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137568.846697:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846704:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675138 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846716:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846722:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846728:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846733:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137568.846736:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846743:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846749:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9709860f4000) 00010000:00010000:0.0:1783137568.846751:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137568.846754:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846760:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67513f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846820:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675131 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72934 expref: 57 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846833:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72934 expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.846841:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:0.0:1783137568.846843:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137568.846846:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234e00, rc 0) 00000100:00100000:0.0:1783137568.846906:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10539:x1869754974391552:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 610us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137568.846914:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 108 00000100:00100000:2.0:1783137568.850074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137568.850121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137568.850209:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974391936 00000100:00100000:1.0:1783137568.850218:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974391936 00000100:00100000:1.0:1783137568.850279:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:1.0:1783137568.850289:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:2353:x1869754974391936:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137568.850304:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137568.850328:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675146 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72934 expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.850354:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:1.0:1783137568.850370:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137568.850445:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:2353:x1869754974391936:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137568.850453:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:0.0:1783137568.851616:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974391808 00000100:00100000:0.0:1783137568.851624:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974391808 00000100:00100000:0.0:1783137568.851742:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 109 00000100:00100000:0.0:1783137568.851751:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10539:x1869754974391808:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137568.851766:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137568.851782:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67514d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7293b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.851901:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.851916:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72926 expref: 56 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.851925:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.851964:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72926 expref: 56 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.851977:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72926 expref: 56 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137568.851989:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990135040:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137568.852058:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f07ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137568.854087:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990135040:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137568.854124:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137568.855330:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137568.855700:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974392064 00000100:00100000:3.0:1783137568.855708:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974392064 00010000:00010000:3.0:1783137568.855741:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72926 expref: 57 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137568.855778:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:3.0:1783137568.855787:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:2351:x1869754974392064:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137568.855992:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137568.856000:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72926 expref: 57 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.856013:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72926 expref: 57 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.856033:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67511c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72926 expref: 57 pid: 5814 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.856047:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:3.0:1783137568.856052:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.856061:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.856069:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.856247:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137568.856301:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:2351:x1869754974392064:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 514us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.856309:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00010000:00010000:0.0:1783137568.857491:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.857504:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137568.857523:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783137568.857663:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67514d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7293b expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.857681:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7293b expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.857690:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:0.0:1783137568.857693:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783137568.857707:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234200, rc 0) 00000100:00100000:0.0:1783137568.857820:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10539:x1869754974391808:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 6070us (7754us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1783137568.857828:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 109 00000100:00100000:2.0:1783137568.860628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137568.860715:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974392320 00000100:00100000:1.0:1783137568.860723:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974392320 00000100:00100000:1.0:1783137568.860955:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:1.0:1783137568.860966:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10539:x1869754974392320:12345-192.168.203.36@tcp:103:lfs.0 00010000:00010000:1.0:1783137568.860981:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137568.861002:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6750b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72911 expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137568.861018:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:1.0:1783137568.861023:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137568.861123:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10539:x1869754974392320:12345-192.168.203.36@tcp:103:lfs.0 Request processed in 159us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137568.861131:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:2.0:1783137568.862720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137568.862782:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974392448 00000100:00100000:0.0:1783137568.862817:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974392448 00000100:00100000:0.0:1783137568.862854:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 110 00000100:00100000:0.0:1783137568.862864:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10539:x1869754974392448:12345-192.168.203.36@tcp:58:lfs.0 00010000:00010000:0.0:1783137568.862970:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.862985:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137568.862996:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783137568.863232:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1783137568.863302:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10539:x1869754974392448:12345-192.168.203.36@tcp:58:lfs.0 Request processed in 439us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137568.863310:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 110 00000100:00100000:2.0:1783137568.865064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137568.865197:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974392576 00000100:00100000:3.0:1783137568.865205:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974392576 00000100:00100000:3.0:1783137568.865250:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:3.0:1783137568.865259:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:10539:x1869754974392576:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137568.865276:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137568.865294:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675169 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72942 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.865341:0:7113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.865352:0:7113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675169 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72942 expref: 56 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.865382:0:7113:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.865395:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675169 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72942 expref: 56 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.865406:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:3.0:1783137568.865409:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783137568.865412:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675169 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72942 expref: 56 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137568.865430:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004600, rc 0) 00000100:00100000:3.0:1783137568.865482:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10539:x1869754974392576:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 223us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137568.865488:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 111 00000100:00100000:2.0:1783137569.191392:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990135168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137569.191467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137569.191764:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990135168 00000100:00100000:3.0:1783137569.191773:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990135168 00000100:00100000:3.0:1783137569.191861:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783137569.191872:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1869754990135168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137569.191905:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137569.191950:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1869754990135168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137569.191958:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1783137569.192302:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783137569.192448:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990135168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137569.255032:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783137569.511034:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137569.511044:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137569.511099:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1783137569.511106:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137569.511223:0:11579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990135296:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783137569.511446:0:11579:0:(client.c:2701:ptlrpc_set_wait()) set ffff970982f76540 going to sleep for 11 seconds 00000100:00100000:1.0:1783137569.517684:0:11579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990135296:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783137569.518508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.518658:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974392704 00000100:00100000:0.0:1783137569.518667:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974392704 00000100:00100000:0.0:1783137569.518724:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:0.0:1783137569.518734:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10540:x1869754974392704:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783137569.518783:0:5815:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783137569.518894:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10540:x1869754974392704:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 161us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137569.518911:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 112 00000100:00100000:3.0:1783137569.523029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137569.524555:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974392832 00000100:00100000:2.0:1783137569.524568:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974392832 00000100:00100000:2.0:1783137569.524693:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:2.0:1783137569.524704:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10540:x1869754974392832:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783137569.524786:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.524830:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.524841:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.524856:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.524863:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.524869:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.524921:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.524929:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.524935:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137569.524972:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783137569.524976:0:7113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137569.524986:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.524997:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525003:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525009:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525016:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137569.525019:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525028:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525039:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:2.0:1783137569.525049:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137569.525054:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525060:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675170 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525074:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525079:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525084:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525089:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137569.525092:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525098:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525106:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff970990e98f00) 00010000:00010000:2.0:1783137569.525108:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137569.525111:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525115:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675177 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525128:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525159:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525165:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525170:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137569.525173:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525179:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525187:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:2.0:1783137569.525190:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137569.525192:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.525197:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67517e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.525275:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10540:x1869754974392832:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 Request processed in 572us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137569.525284:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 113 00000100:00100000:1.0:1783137569.527913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.527978:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974393088 00000100:00100000:0.0:1783137569.527987:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974393088 00000100:00100000:0.0:1783137569.528040:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:0.0:1783137569.528050:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:10540:x1869754974393088:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137569.528069:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137569.528089:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675185 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72949 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.528189:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.528204:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.528214:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137569.528225:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783137569.529065:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.529076:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.529084:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.529090:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137569.529094:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.529115:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.529129:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:0.0:1783137569.529131:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783137569.529137:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.529153:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac67518c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.529202:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675185 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72949 expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.529213:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:0.0:1783137569.529215:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137569.529219:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac675185 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72949 expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.529228:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235c00, rc 0) 00000100:00100000:0.0:1783137569.529669:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:10540:x1869754974393088:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 1617us (1763us total) trans 4294967398 rc 301/301 00000100:00100000:0.0:1783137569.529677:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 114 00000100:00100000:2.0:1783137569.547129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137569.547247:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974393216 00000100:00100000:1.0:1783137569.547257:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974393216 00000100:00100000:1.0:1783137569.547318:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:1.0:1783137569.547328:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:10540:x1869754974393216:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783137569.547381:0:5816:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783137569.547501:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:10540:x1869754974393216:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 173us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137569.547509:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:3.0:1783137569.550221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137569.551646:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974393472 00000100:00100000:1.0:1783137569.551658:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974393472 00000100:00100000:1.0:1783137569.551758:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:1.0:1783137569.551767:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:10540:x1869754974393472:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137569.551817:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137569.551820:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783137569.551845:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67512a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7292d expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.551863:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:1.0:1783137569.551868:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137569.551879:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac67519a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72950 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783137569.553063:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1783137569.553297:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6751a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.553311:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6751a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.553323:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6751a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.553394:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d800/0x88def104ac67519a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72950 expref: 59 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.553411:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6751a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72950 expref: 58 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.553432:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff970990e51900) 00010000:00010000:1.0:1783137569.553435:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137569.553438:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c000, rc 0) 00000100:00100000:1.0:1783137569.553501:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:10540:x1869754974393472:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 1735us (3289us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1783137569.553510:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:3.0:1783137569.559845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.560038:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974393728 00000100:00100000:0.0:1783137569.560047:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974393728 00000100:00100000:0.0:1783137569.560115:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:0.0:1783137569.560125:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:10540:x1869754974393728:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783137569.560205:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137569.560229:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6751a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72950 expref: 58 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560246:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff970990e51900) 00010000:00010000:0.0:1783137569.560255:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137569.560272:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560284:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560293:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560327:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560334:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560339:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560576:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560584:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560590:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560604:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137569.560610:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560616:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560627:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137569.560630:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137569.560633:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560638:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560648:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560653:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560658:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560663:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137569.560665:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560670:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560930:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x20cb13a1 (ffff9709860f4000) 00010000:00010000:0.0:1783137569.560933:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137569.560938:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.560944:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x20cb13a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.561774:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:10540:x1869754974393728:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 1644us (1977us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783137569.561783:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:3.0:1783137569.575498:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.575706:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974393856 00000100:00100000:0.0:1783137569.575716:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974393856 00000100:00100000:0.0:1783137569.575774:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:0.0:1783137569.575784:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:10540:x1869754974393856:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137569.575837:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137569.575861:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72957 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.575897:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.575909:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.575919:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.576015:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72957 expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.576038:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72957 expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.576047:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:0.0:1783137569.576051:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783137569.576054:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235c00, rc 0) 00000100:00100000:0.0:1783137569.576111:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:10540:x1869754974393856:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 328us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137569.576118:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:3.0:1783137569.587884:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.588050:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974394112 00000100:00100000:0.0:1783137569.588060:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974394112 00000100:00100000:0.0:1783137569.588129:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:0.0:1783137569.588139:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:10540:x1869754974394112:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783137569.588230:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.588247:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.588259:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783137569.588509:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1783137569.588520:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325485727868ns, next at 326485725905ns, rc = 0 00000004:00010000:0.0:1783137569.588600:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000745ea76 reply state 000000004defa29d transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.588625:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137569.588727:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:10540:x1869754974394112:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 588us (849us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1783137569.588735:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 119 00010000:00010000:1.0:1783137569.590869:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.590885:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.590892:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.590898:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137569.590903:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.590911:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137569.590928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:1.0:1783137569.590928:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:1.0:1783137569.590943:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783137569.590948:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.590955:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac6751cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.591079:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974394240 00000100:00100000:2.0:1783137569.591088:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974394240 00000100:00100000:2.0:1783137569.591128:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:2.0:1783137569.591137:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:10540:x1869754974394240:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137569.591174:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137569.591189:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7295e expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.591302:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7295e expref: 60 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.591479:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7295e expref: 60 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.591501:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:2.0:1783137569.591504:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137569.591506:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051400, rc 0) 00000100:00100000:2.0:1783137569.591623:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:10540:x1869754974394240:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 486us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137569.591631:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:3.0:1783137569.597747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.599619:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974394368 00000100:00100000:0.0:1783137569.599633:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974394368 00000100:00100000:0.0:1783137569.599724:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:0.0:1783137569.599738:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2354:x1869754974394368:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783137569.600052:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2354:x1869754974394368:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 317us (2312us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783137569.600060:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00080000:1.0:1783137569.602232:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137569.609322:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137569.609419:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974394624 00000100:00100000:2.0:1783137569.609437:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974394624 00000100:00100000:2.0:1783137569.609495:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:2.0:1783137569.609513:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:10540:x1869754974394624:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783137569.609756:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:10540:x1869754974394624:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 252us (443us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783137569.609764:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:2.0:1783137569.615646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.623120:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974394880 00000100:00100000:0.0:1783137569.623134:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974394880 00000100:00100000:0.0:1783137569.623210:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:0.0:1783137569.623221:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:10540:x1869754974394880:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137569.623346:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:10540:x1869754974394880:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 126us (7708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137569.623354:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 121 00000100:00100000:3.0:1783137569.626099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137569.626470:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974395008 00000100:00100000:2.0:1783137569.626480:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974395008 00000100:00100000:2.0:1783137569.627571:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:2.0:1783137569.627587:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:10540:x1869754974395008:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137569.627607:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137569.627625:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6751d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72965 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.627685:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6751e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.627698:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6751e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.627709:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6751e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137569.627742:0:7113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137569.627759:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6751e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.627782:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6751d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72965 expref: 63 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.627833:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6751e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72965 expref: 62 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.627841:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:2.0:1783137569.627844:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783137569.627847:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051200, rc 0) 00000100:00100000:2.0:1783137569.627905:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:10540:x1869754974395008:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 323us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137569.627925:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:1.0:1783137569.642601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137569.642885:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974395136 00000100:00100000:3.0:1783137569.642894:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974395136 00000100:00100000:3.0:1783137569.642974:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:3.0:1783137569.642984:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2351:x1869754974395136:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137569.643001:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137569.643041:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7296c expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137569.643067:0:6619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a488521, blocks: 0x1 00010000:00010000:3.0:1783137569.643085:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1783137569.643089:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137569.643098:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7296c expref: 10 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.643115:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7296c expref: 10 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.643128:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004400, rc 0) 00000100:00100000:3.0:1783137569.643190:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:2351:x1869754974395136:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 207us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137569.643197:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:1.0:1783137569.647297:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.647377:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974395392 00000100:00100000:0.0:1783137569.647386:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974395392 00000100:00100000:0.0:1783137569.647438:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 123 00000100:00100000:0.0:1783137569.647448:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:10540:x1869754974395392:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137569.647555:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:10540:x1869754974395392:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137569.647576:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 123 00000100:00100000:3.0:1783137569.650267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137569.650361:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974395520 00000100:00100000:1.0:1783137569.650370:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974395520 00000100:00100000:1.0:1783137569.650415:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:1.0:1783137569.650424:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:10540:x1869754974395520:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137569.650439:0:8200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137569.650454:0:8200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72973 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.650482:0:8200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7296c expref: 11 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.650492:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137569.650496:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137569.650501:0:8200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 11 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.650538:0:8200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7296c expref: 11 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.650568:0:8200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7296c expref: 11 pid: 6619 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137569.650582:0:8200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd088700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8200:1869754990135424:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137569.650658:0:8200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bc952cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137569.653204:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137569.653753:0:8200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd088700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8200:1869754990135424:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137569.653781:0:8200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 11 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.653822:0:8200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c200, rc 0) 00000100:00100000:1.0:1783137569.653882:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:10540:x1869754974395520:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 3447us (3611us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137569.653890:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:2.0:1783137569.657466:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974395648 00000100:00100000:2.0:1783137569.657479:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974395648 00010000:00010000:2.0:1783137569.657595:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7296c expref: 11 pid: 6619 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.657700:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:2.0:1783137569.657711:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:2351:x1869754974395648:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137569.657728:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137569.657750:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7296c expref: 11 pid: 6619 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.657765:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7296c expref: 11 pid: 6619 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.657817:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002239feb2/0x88def104ac6751e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7296c expref: 11 pid: 6619 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.657834:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137569.657839:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137569.657848:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 10 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.657858:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 10 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.658595:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 10 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.658613:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc9d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5800:1869754990135552:192.168.203.36@tcp:105: 00000100:00100000:2.0:1783137569.658703:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff970982f76540 going to sleep for 11 seconds 00000100:00100000:2.0:1783137569.671455:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc9d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5800:1869754990135552:192.168.203.36@tcp:105: 00010000:00010000:2.0:1783137569.671480:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137569.671542:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:2351:x1869754974395648:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 13833us (18346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137569.671553:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:1.0:1783137569.673630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137569.673722:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974395776 00000100:00100000:3.0:1783137569.673731:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974395776 00002000:00100000:3.0:1783137569.673777:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9709bd088700 x1869754974395776/t0(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:475/0 lens 504/0 e 0 to 0 dl 1783137580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783137569.673788:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd088700 with x1869754974395776 ext(0->12) 00002000:00010000:3.0:1783137569.673832:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709bd088700 00000100:00100000:3.0:1783137569.673862:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:3.0:1783137569.673879:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:2352:x1869754974395776:12345-192.168.203.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783137569.674458:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+12:2352:x1869754974395776:12345-192.168.203.36@tcp:4:lhsmtool_posix.0 Request processed in 584us (832us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783137569.674468:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00002000:00100000:0.0:1783137569.674475:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9709bd088700 x1869754974395776/t4294967308(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:475/0 lens 504/448 e 0 to 0 dl 1783137580 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137569.674484:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd088700 with x1869754974395776 ext(0->12) 00002000:00010000:0.0:1783137569.674488:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709bd088700 00000100:00100000:3.0:1783137569.676378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.676447:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974395904 00000100:00100000:0.0:1783137569.676455:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974395904 00000100:00100000:0.0:1783137569.676506:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:0.0:1783137569.676515:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:10540:x1869754974395904:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1783137569.703609:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783137569.710101:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990135680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137569.710993:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137569.712067:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990135680 00000100:00100000:2.0:1783137569.712079:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990135680 00000100:00100000:2.0:1783137569.712608:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783137569.712620:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990135680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137569.712645:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137569.712720:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990135680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137569.712736:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1783137569.712770:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783137569.713345:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990135680:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1783137569.738954:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1783137569.738967:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1783137569.739001:0:5836:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9709adee7480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1783137569.739007:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff97098730a500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9709888afe40 00000020:00080000:3.0:1783137569.739011:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff97098730a600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9709bcfbf400 00000020:00080000:3.0:1783137569.739206:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1783137569.739213:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990135808:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783137569.739220:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137569.739237:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990135936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783137569.739503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783137569.739578:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1783137569.739594:0:5836:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1783137569.739848:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1783137569.739856:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783137569.739866:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990136064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783137569.740018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137569.740057:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990135936 00000100:00100000:3.0:1783137569.740063:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990135936 00000100:00100000:3.0:1783137569.740097:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990136064 00000100:00100000:3.0:1783137569.740100:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990136064 00000100:00100000:3.0:1783137569.740120:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783137569.740131:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869754990135936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783137569.740296:0:6618:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783137569.740300:0:6618:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783137569 00002000:00010000:3.0:1783137569.740302:0:6618:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783137569.740304:0:6618:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783137569 -> 1783137569 00002000:00010000:3.0:1783137569.740319:0:6618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783137569.740526:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1869754990135936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 397us (1023us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1783137569.740535:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783137569.740552:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783137569.740559:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1869754990136064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783137569.740574:0:6618:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1783137569.740712:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a488520, atime: 0x6a488520, ctime: 0x6a488520, blocks: 0x1 00010000:00010000:3.0:1783137569.740721:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.740829:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1783137569.740833:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137569.740840:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.740856:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.740866:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.740941:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.740959:0:6618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783137569.741180:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:10540:x1869754974395904:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 Request processed in 64662us (64805us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137569.741196:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 124 00000004:00080000:2.0:1783137569.741636:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709bd921500/2, rc 0, transno 4294967309 00000100:00100000:2.0:1783137569.741644:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990135936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783137569.742228:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137569.742506:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990135808 00000100:00100000:0.0:1783137569.742513:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990135808 00000100:00100000:0.0:1783137569.742540:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783137569.742555:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1869754990135808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783137569.742582:0:6619:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1783137569.742761:0:6619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.742779:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d2 expref: 11 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.742812:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1783137569.742816:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137569.742820:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.742849:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d2 expref: 11 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.742862:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d2 expref: 11 pid: 6619 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.742887:0:6619:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990136192:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137569.742964:0:6619:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f07ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137569.743059:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3307:x1869754990136064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2492us (3031us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783137569.743073:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1783137569.743099:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137569.743106:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.743114:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137569.743119:0:11060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.743128:0:11060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.743158:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.743166:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fad381bf/0x88def104ac6751f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.743184:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137569.743185:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137569.743187:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783137569.743208:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000020:00080000:3.0:1783137569.743238:0:5836:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff970997f57f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1783137569.743242:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9709887fa300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff970997f57cc0 00000020:00080000:3.0:1783137569.743246:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9709887fab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9709bd2ad000 00000004:00080000:3.0:1783137569.743273:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1783137569.743628:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1783137569.743986:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783137569.745038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.745260:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974396032 00000100:00100000:0.0:1783137569.745267:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974396032 00000100:00100000:0.0:1783137569.745306:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1783137569.745315:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+12:2351:x1869754974396032:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1783137569.747912:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709b7caaa00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1783137569.747924:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990136064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783137569.755288:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.755325:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974396160 00000100:00100000:0.0:1783137569.755342:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974396160 00010000:00010000:0.0:1783137569.755380:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d2 expref: 13 pid: 6619 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.755434:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:0.0:1783137569.755442:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2351:x1869754974396160:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137569.755456:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137569.755463:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d2 expref: 13 pid: 6619 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.755475:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d2 expref: 13 pid: 6619 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.755497:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137569.755501:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137569.755506:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.755515:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.755533:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137569.755579:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2351:x1869754974396160:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 137us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137569.755587:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 56 00010000:00010000:2.0:1783137569.758871:0:6619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac674fb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728d2 expref: 12 pid: 6619 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.758903:0:6619:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990136192:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137569.758926:0:6619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.758937:0:6619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.758945:0:6619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.758956:0:6619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.758963:0:6619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.758988:0:6619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783137569.759555:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1869754990135808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16989us (17318us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783137569.759564:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1783137569.760283:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137569.760291:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.760301:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137569.760305:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.760322:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.760350:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.760358:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f98d5c9/0x88def104ac6751fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.760384:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137569.760386:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137569.760388:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783137569.761199:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709894e4700/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783137569.761208:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990135808:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1783137569.807489:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1783137569.807515:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1783137569.810400:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974396032:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 Request processed in 65076us (65355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137569.810423:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1783137569.816256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137569.816346:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974396416 00000100:00100000:2.0:1783137569.816355:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974396416 00000100:00100000:2.0:1783137569.816416:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 125 00000100:00100000:2.0:1783137569.816426:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:10540:x1869754974396416:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783137569.816474:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137569.816499:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6751e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72965 expref: 15 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.816518:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:2.0:1783137569.816523:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137569.816551:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.816563:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.816572:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137569.817030:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004640cbe2 reply state 0000000001481ee7 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.817040:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137569.817133:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:10540:x1869754974396416:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 708us (886us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1783137569.817150:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 125 00010000:00010000:0.0:1783137569.818828:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.818842:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.818850:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.818857:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137569.818861:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.818925:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.818939:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:0.0:1783137569.818942:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137569.818947:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.818953:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675203 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.820130:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137569.820865:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974396544 00000100:00100000:3.0:1783137569.820942:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974396544 00000100:00100000:3.0:1783137569.821000:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:3.0:1783137569.821011:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974396544:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783137569.821461:0:6620:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783137569.821466:0:6620:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1783137569 -> 1783137568 00002000:00010000:3.0:1783137569.821468:0:6620:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783137568 00002000:00010000:3.0:1783137569.821471:0:6620:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783137569 -> 1783137568 00002000:00010000:3.0:1783137569.821473:0:6620:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783137569.821528:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974396544:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 518us (1403us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783137569.821536:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:0.0:1783137569.825190:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137569.825318:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974396800 00000100:00100000:2.0:1783137569.825328:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974396800 00000100:00100000:2.0:1783137569.825380:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:2.0:1783137569.825391:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:10540:x1869754974396800:12345-192.168.203.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783137569.825463:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.825480:0:7113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72957 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.825489:0:7113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.825523:0:7113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72957 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.825537:0:7113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72957 expref: 15 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.825551:0:7113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990136320:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137569.825631:0:7113:0:(client.c:2701:ptlrpc_set_wait()) set ffff970984f10900 going to sleep for 11 seconds 00000100:00100000:2.0:1783137569.828008:0:7113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990136320:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137569.828034:0:7113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.829328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137569.829400:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974396928 00000100:00100000:3.0:1783137569.829446:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974396928 00010000:00010000:3.0:1783137569.829481:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72957 expref: 16 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137569.829518:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:3.0:1783137569.829527:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:2351:x1869754974396928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137569.829542:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137569.829549:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72957 expref: 16 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.829561:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72957 expref: 16 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.829595:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6751c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72957 expref: 16 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.829611:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:3.0:1783137569.829616:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.829624:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.829631:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.829664:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137569.829714:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:2351:x1869754974396928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 187us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137569.829722:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00010000:00010000:0.0:1783137569.830161:0:7113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.830179:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.830206:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.830214:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.830221:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.830227:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137569.830231:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.830238:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.830248:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:0.0:1783137569.830252:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783137569.830256:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.830262:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67520a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.830316:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:10540:x1869754974396800:12345-192.168.203.36@tcp:55:lhsmtool_posix.0 Request processed in 4927us (5135us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783137569.830324:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 126 00000100:00100000:0.0:1783137569.832904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137569.833035:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974397056 00000100:00100000:2.0:1783137569.833045:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974397056 00000100:00100000:2.0:1783137569.833095:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:2.0:1783137569.833104:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974397056:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783137569.833150:0:6619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.833192:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 7 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.833201:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137569.833206:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137569.833210:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.833244:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 7 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.833257:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 7 pid: 8200 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.833271:0:6619:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990136448:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137569.833336:0:6619:0:(client.c:2701:ptlrpc_set_wait()) set ffff970984f10900 going to sleep for 11 seconds 00000100:00100000:2.0:1783137569.836620:0:6619:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990136448:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137569.836648:0:6619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.838365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137569.838775:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974397184 00000100:00100000:3.0:1783137569.838785:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974397184 00010000:00010000:3.0:1783137569.838842:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 8 pid: 8200 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137569.838882:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:3.0:1783137569.838890:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974397184:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137569.838905:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137569.838925:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 8 pid: 8200 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.838958:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 8 pid: 8200 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.838980:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0157ba1/0x88def104ac6751ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72973 expref: 8 pid: 8200 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.838995:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783137569.838999:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783137569.839004:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.839012:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.839045:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137569.839092:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974397184:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 202us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137569.839305:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 58 00010000:00010000:2.0:1783137569.839388:0:6619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.839398:0:6619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.839430:0:6619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.839439:0:6619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.839448:0:6619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.839466:0:6619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137569.839470:0:6619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.839479:0:6619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.839491:0:6619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.839498:0:6619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675211 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.839546:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974397056:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 Request processed in 6443us (6649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137569.839554:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:0.0:1783137569.842186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137569.842296:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974397440 00000100:00100000:2.0:1783137569.842305:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974397440 00000100:00100000:2.0:1783137569.842368:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 127 00000100:00100000:2.0:1783137569.842378:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:10540:x1869754974397440:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783137569.842448:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.842474:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.842484:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.842675:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.842686:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7295e expref: 15 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.842693:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.842720:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7295e expref: 15 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.842732:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7295e expref: 15 pid: 7113 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.842746:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990136576:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137569.842832:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff970984f10900 going to sleep for 11 seconds 00000100:00100000:2.0:1783137569.844893:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990136576:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137569.844917:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.848161:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137569.848415:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974397568 00000100:00100000:3.0:1783137569.848424:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974397568 00010000:00010000:3.0:1783137569.848459:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7295e expref: 16 pid: 7113 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137569.848490:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:3.0:1783137569.848499:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:2352:x1869754974397568:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137569.848526:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137569.848532:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7295e expref: 16 pid: 7113 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.848544:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7295e expref: 16 pid: 7113 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.848564:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6751d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7295e expref: 16 pid: 7113 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.848578:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:3.0:1783137569.848583:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.848591:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.848598:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.848627:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137569.848679:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:2352:x1869754974397568:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 181us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137569.848687:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 59 00010000:00010000:0.0:1783137569.849833:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.849845:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137569.850350:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1783137569.850497:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1783137569.850540:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1783137569.850615:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1869754990136704:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783137569.850674:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137569.850750:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bc952b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137569.861650:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990136704 00000100:00100000:3.0:1783137569.861666:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990136704 00000100:00100000:3.0:1783137569.861743:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783137569.861754:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1869754990136704:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783137569.862349:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1869754990136704:12345-0@lo:1000:mdt00_002.0 Request processed in 595us (11672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137569.862364:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137569.862458:0:5816:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1783137569.862465:0:5816:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1783137569.862484:0:5816:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709bd921500, transno 4294967309 00000100:00100000:0.0:1783137569.862501:0:5816:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9709894e4700 x1869754990135808/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783137585 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137569.862513:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1869754990136704:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1783137569.863030:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1783137569.863105:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1869754990136832:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783137569.863156:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137569.863187:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f07c240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137569.863219:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990136832 00000100:00100000:2.0:1783137569.863226:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990136832 00000100:00100000:2.0:1783137569.863273:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137569.863284:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5816:x1869754990136832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783137569.863489:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5816:x1869754990136832:12345-0@lo:1000:mdt00_002.0 Request processed in 207us (332us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783137569.863497:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783137569.864282:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1869754990136832:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783137569.864317:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864335:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864342:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864348:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137569.864352:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864359:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864374:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9709860f4000) 00010000:00010000:0.0:1783137569.864378:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137569.864382:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864388:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac67521f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864416:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864421:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864426:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864431:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137569.864439:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864445:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864454:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:0.0:1783137569.864456:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137569.864462:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675169 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72942 expref: 18 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864473:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675169 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72942 expref: 18 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864481:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72942 expref: 18 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137569.864509:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72942 expref: 18 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.864520:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990136960:192.168.203.36@tcp:105: 00000100:00100000:0.0:1783137569.864589:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f07c240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137569.866940:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137569.867087:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990136960:192.168.203.36@tcp:105: 00010000:00010000:2.0:1783137569.867116:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867125:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac675162 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867173:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867185:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867195:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867206:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867212:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867229:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867234:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137569.867237:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867245:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867257:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:2.0:1783137569.867260:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137569.867263:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867269:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675226 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867279:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867285:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867291:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867296:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137569.867299:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867315:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867324:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:2.0:1783137569.867327:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783137569.867330:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137569.867336:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675218 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137569.867549:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:10540:x1869754974397440:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 25170us (25368us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1783137569.867558:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 127 00000020:00080000:2.0:1783137569.867564:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783137569.868135:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137569.868150:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137569.868660:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1783137569.868668:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783137569.868890:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974397696 00000100:00100000:1.0:1783137569.868897:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974397696 00000100:00100000:1.0:1783137569.868944:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:1.0:1783137569.868954:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:10539:x1869754974397696:12345-192.168.203.36@tcp:49:lfs.0 00000100:00100000:1.0:1783137569.869071:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:10539:x1869754974397696:12345-192.168.203.36@tcp:49:lfs.0 Request processed in 118us (2138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137569.869079:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:0.0:1783137569.879332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137569.879373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137569.879451:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974398208 00000100:00100000:2.0:1783137569.879460:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974398208 00000100:00100000:2.0:1783137569.879513:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 128 00000100:00100000:2.0:1783137569.879523:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:10539:x1869754974398208:12345-192.168.203.36@tcp:58:lfs.0 00000040:00080000:2.0:1783137569.879888:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1783137569.879966:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:10539:x1869754974398208:12345-192.168.203.36@tcp:58:lfs.0 Request processed in 443us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137569.879976:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 128 00000100:00100000:1.0:1783137569.880114:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974397952 00000100:00100000:1.0:1783137569.880119:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974397952 00000100:00100000:1.0:1783137569.880164:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:1.0:1783137569.880172:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:10540:x1869754974397952:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783137569.880596:0:5817:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783137569.880691:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:1.0:1783137569.880747:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.880762:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.880774:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.880783:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.880824:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.880831:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.880851:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137569.880882:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137569.880890:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.880899:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137569.880903:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.880910:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.880923:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff970990e51b00) 00010000:00010000:3.0:1783137569.880926:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783137569.880930:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.880936:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac67522d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.880952:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137569.880954:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137569.880955:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137569.881097:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:10540:x1869754974397952:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 924us (1772us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1783137569.881106:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 32 00000020:00080000:1.0:1783137569.881111:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783137569.914450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137569.914515:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974398336 00000100:00100000:3.0:1783137569.914525:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974398336 00000100:00100000:3.0:1783137569.914582:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 129 00000100:00100000:3.0:1783137569.914593:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:10542:x1869754974398336:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137569.914628:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137569.914647:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675234 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7297a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.914706:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.914720:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.914732:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.914745:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.914753:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.914759:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.915120:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.915131:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7293b expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.915149:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.915182:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7293b expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.915201:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7293b expref: 21 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137569.915215:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990137088:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137569.915288:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709afd0f900 going to sleep for 11 seconds 00000100:00100000:3.0:1783137569.918473:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990137088:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137569.918502:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137569.920575:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137569.922112:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974398592 00000100:00100000:1.0:1783137569.922123:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974398592 00000100:00100000:1.0:1783137569.922206:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:1.0:1783137569.922216:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+22:5569:x1869754974398592:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783137569.922588:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:5569:x1869754974398592:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 372us (2018us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1783137569.922596:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:2.0:1783137569.924190:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137569.924325:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974398720 00000100:00100000:3.0:1783137569.924332:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974398720 00010000:00010000:3.0:1783137569.924372:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7293b expref: 23 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137569.924413:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:3.0:1783137569.924422:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:2352:x1869754974398720:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137569.924434:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137569.924440:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7293b expref: 23 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.924452:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7293b expref: 23 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.924472:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675154 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7293b expref: 23 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.924506:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:3.0:1783137569.924511:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.924519:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.924527:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137569.924558:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137569.924607:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+22:2352:x1869754974398720:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 186us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137569.924614:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00010000:00010000:1.0:1783137569.925998:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926024:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137569.926066:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783137569.926070:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137569.926088:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926101:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926112:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926118:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926125:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926131:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137569.926135:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926164:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926176:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:1.0:1783137569.926179:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137569.926184:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926202:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac67523b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926216:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926223:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926228:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926233:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137569.926237:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926242:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926251:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff970987960600) 00010000:00010000:1.0:1783137569.926253:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137569.926256:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926262:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac675242 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926298:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675234 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7297a expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926312:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7297a expref: 21 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137569.926325:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:1.0:1783137569.926328:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137569.926330:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005e00, rc 0) 00000100:00100000:1.0:1783137569.926398:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:10542:x1869754974398336:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 11806us (11956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137569.926405:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 129 00010000:00010000:0.0:1783137570.282551:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783137570.307272:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1783137570.307294:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1783137570.307301:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:1.0:1783137570.694755:0:11946:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783137570.694763:0:11946:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783137570.694844:0:11946:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783137570.694850:0:11946:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1783137570.918987:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137570.918997:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137570.919464:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783137570.919472:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137570.919975:0:11579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990137216:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783137570.923359:0:11579:0:(client.c:2701:ptlrpc_set_wait()) set ffff970982f76540 going to sleep for 11 seconds 00000100:00100000:3.0:1783137570.931949:0:11579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990137216:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783137570.933355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137570.933485:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974398848 00000100:00100000:2.0:1783137570.933494:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974398848 00000100:00100000:2.0:1783137570.933563:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 130 00000100:00100000:2.0:1783137570.933573:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:10554:x1869754974398848:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783137570.933618:0:5815:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783137570.933716:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:10554:x1869754974398848:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 143us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137570.933724:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 130 00000100:00080000:1.0:1783137570.933824:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137570.944170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137570.944252:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974399104 00000100:00100000:0.0:1783137570.944284:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974399104 00000100:00100000:0.0:1783137570.944331:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:0.0:1783137570.944341:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:10554:x1869754974399104:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137570.944360:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137570.944390:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675250 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72981 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.944484:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac675257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.944497:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac675257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.944508:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac675257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137570.944519:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783137570.944640:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675250 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72981 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.944657:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac675257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72981 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.944666:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:0.0:1783137570.944669:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137570.944672:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235000, rc 0) 00000100:00100000:0.0:1783137570.944732:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:10554:x1869754974399104:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 393us (578us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1783137570.944740:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:2.0:1783137570.952324:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137570.952436:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137570.952690:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974399360 00000100:00100000:0.0:1783137570.952700:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974399360 00000100:00100000:0.0:1783137570.952760:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 132 00000100:00100000:0.0:1783137570.952771:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:10554:x1869754974399360:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783137570.952990:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974399488 00000100:00100000:3.0:1783137570.952995:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974399488 00010000:00010000:0.0:1783137570.954271:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.954290:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.954302:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.954473:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.954480:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.954486:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.954491:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137570.954494:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.954500:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.954511:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:0.0:1783137570.954514:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783137570.954530:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137570.954536:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675265 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137570.954676:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+25:10554:x1869754974399360:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 1904us (2358us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1783137570.954687:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 132 00000100:00100000:3.0:1783137570.954783:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:3.0:1783137570.954814:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:2352:x1869754974399488:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137570.954827:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137570.954848:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac675257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72981 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137570.954858:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:3.0:1783137570.954862:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137570.954883:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:2352:x1869754974399488:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 92us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137570.954889:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000040:00080000:2.0:1783137570.955167:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137570.955172:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137570.955680:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783137570.955688:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783137570.968233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137570.968373:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974399744 00000100:00100000:2.0:1783137570.968383:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974399744 00000100:00100000:2.0:1783137570.968436:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1783137570.968445:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:10554:x1869754974399744:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783137570.968662:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:10554:x1869754974399744:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 218us (438us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1783137570.968670:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1783137571.126674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137571.126732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137571.126770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137571.126840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137571.126973:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974400256 00000100:00100000:1.0:1783137571.126983:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974400256 00000100:00100000:1.0:1783137571.127034:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974400128 00000100:00100000:1.0:1783137571.127038:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974400128 00000100:00100000:1.0:1783137571.127063:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:1.0:1783137571.127072:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974400256:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137571.127152:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974400256:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 79us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137571.127160:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:1.0:1783137571.127183:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:1.0:1783137571.127215:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974400128:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137571.127245:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974400128:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 33us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137571.127252:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00080000:1.0:1783137571.127270:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137571.127287:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137571.127928:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974400000 00000100:00100000:0.0:1783137571.127934:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974400000 00000100:00100000:0.0:1783137571.127970:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:0.0:1783137571.127978:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:2352:x1869754974400000:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137571.128024:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:2352:x1869754974400000:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 47us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137571.128031:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 131 00000100:00100000:2.0:1783137571.128190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137571.128515:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974399872 00000100:00100000:3.0:1783137571.128520:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974399872 00000100:00100000:3.0:1783137571.128562:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 286 00000100:00100000:3.0:1783137571.128571:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974399872:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137571.128608:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974399872:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 39us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137571.128615:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 286 00000100:00100000:0.0:1783137571.128968:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974400384 00000100:00100000:0.0:1783137571.128973:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974400384 00000100:00100000:0.0:1783137571.129013:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 132 00000100:00100000:0.0:1783137571.129021:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974400384:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137571.129057:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974400384:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 37us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137571.129064:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 132 00000100:00080000:3.0:1783137571.133644:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783137571.306884:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137572.327099:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783137572.577371:0:11998:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137572.577457:0:11998:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137572.577511:0:11998:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783137572.577523:0:11998:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783137572.748882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137572.749576:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974400640 00000100:00100000:2.0:1783137572.749587:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974400640 00000100:00100000:2.0:1783137572.749662:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 133 00000100:00100000:2.0:1783137572.749672:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:10574:x1869754974400640:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137572.749691:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137572.749732:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67526c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72988 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137572.749844:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675273 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137572.750031:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137572.750045:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137572.750059:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783137572.750205:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67526c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72988 expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137572.750223:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675273 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72988 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137572.750233:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:2.0:1783137572.750236:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783137572.750239:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051c00, rc 0) 00000100:00100000:2.0:1783137572.750438:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:10574:x1869754974400640:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 766us (1562us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1783137572.750458:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 133 00000100:00080000:2.0:1783137572.750481:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137572.754812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137572.757705:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974400768 00000100:00100000:3.0:1783137572.757717:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974400768 00000100:00100000:3.0:1783137572.757777:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 134 00000100:00100000:3.0:1783137572.757787:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:10574:x1869754974400768:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:3.0:1783137572.758054:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137572.758070:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137572.758082:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137572.758130:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137572.758137:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137572.758143:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137572.758148:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137572.758152:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137572.758160:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137572.758172:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:3.0:1783137572.758175:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137572.758179:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137572.758185:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac675281 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137572.758438:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:10574:x1869754974400768:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 651us (3651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137572.758447:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 134 00000100:00100000:3.0:1783137572.858713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137572.858892:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974400896 00000100:00100000:1.0:1783137572.858902:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974400896 00000100:00100000:1.0:1783137572.858957:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:1.0:1783137572.858967:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2354:x1869754974400896:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:1.0:1783137572.859087:0:8200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137572.859108:0:8200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3931a7/0x88def104ac675288 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7298f expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137572.859143:0:8200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a488520, atime: 0x6a488520, ctime: 0x6a488520, blocks: 0xb 00010000:00010000:1.0:1783137572.859161:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:1.0:1783137572.859165:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137572.859176:0:8200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3931a7/0x88def104ac675288 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7298f expref: 7 pid: 8200 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137572.859194:0:8200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd3931a7/0x88def104ac675288 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7298f expref: 7 pid: 8200 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137572.859206:0:8200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d800, rc 0) 00000100:00100000:1.0:1783137572.859361:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2354:x1869754974400896:12345-192.168.203.36@tcp:101:cat.0 Request processed in 394us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137572.859368:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:3.0:1783137572.861961:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137572.862137:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974401024 00000100:00100000:0.0:1783137572.862146:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974401024 00002000:00100000:0.0:1783137572.862193:0:6625:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff970986662d80 x1869754974401024/t0(0) o3->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:478/0 lens 488/0 e 0 to 0 dl 1783137583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137572.862217:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff970986662d80 with x1869754974401024 ext(0->4095) 00002000:00010000:0.0:1783137572.862223:0:6625:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff970986662d80 00000100:00100000:0.0:1783137572.862257:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:0.0:1783137572.862267:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974401024:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:0.0:1783137572.862474:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974401024:12345-192.168.203.36@tcp:3:cat.0 Request processed in 209us (522us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783137572.862482:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00002000:00100000:0.0:1783137572.862489:0:6625:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff970986662d80 x1869754974401024/t0(0) o3->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:478/0 lens 488/4536 e 0 to 0 dl 1783137583 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137572.862497:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff970986662d80 with x1869754974401024 ext(0->4095) 00002000:00010000:0.0:1783137572.862500:0:6625:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff970986662d80 00010000:00010000:0.0:1783137573.351023:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137573.801256:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990137344:0@lo:400:kworker.0 00000100:00100000:2.0:1783137573.801307:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990137600:0@lo:400:kworker.0 00000100:00100000:2.0:1783137573.801354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137573.801360:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137573.801441:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990137472:0@lo:400:kworker.0 00000100:00100000:3.0:1783137573.802889:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990137856:0@lo:400:kworker.0 00000100:00100000:3.0:1783137573.802943:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137573.802995:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990137344 00000100:00100000:3.0:1783137573.803003:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990137344 00000100:00100000:3.0:1783137573.803043:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1783137573.803051:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990137344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137573.803099:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990137344:12345-0@lo:400:kworker.0 Request processed in 48us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137573.803106:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1783137573.803165:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990137344:0@lo:400:kworker.0 00000100:00100000:3.0:1783137573.803204:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990137728:0@lo:400:kworker.0 00000100:00100000:3.0:1783137573.803231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137573.803262:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990137728 00000100:00100000:3.0:1783137573.803266:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990137728 00000100:00100000:3.0:1783137573.803300:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783137573.803322:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1869754990137728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137573.803357:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1869754990137728:12345-0@lo:400:kworker.0 Request processed in 52us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137573.803363:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1783137573.803380:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137573.803402:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990137728:0@lo:400:kworker.0 00000100:00100000:3.0:1783137573.803935:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990137600 00000100:00100000:3.0:1783137573.803940:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990137600 00000100:00100000:3.0:1783137573.804014:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990137856 00000100:00100000:3.0:1783137573.804018:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990137856 00000100:00080000:2.0:1783137573.804062:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137573.804087:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783137573.804096:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990137600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137573.804159:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990137600:12345-0@lo:400:kworker.0 Request processed in 65us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137573.804166:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783137573.804198:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990137600:0@lo:400:kworker.0 00000100:00100000:3.0:1783137573.804292:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783137573.804299:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990137856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137573.804349:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990137856:12345-0@lo:400:kworker.0 Request processed in 50us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137573.804356:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783137573.804387:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990137856:0@lo:400:kworker.0 00000100:00100000:1.0:1783137573.808612:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137573.808696:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990137984:0@lo:400:kworker.0 00000100:00100000:1.0:1783137573.808742:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137573.809008:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990137984 00000100:00100000:2.0:1783137573.809015:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990137984 00000100:00100000:2.0:1783137573.809075:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783137573.809085:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990137984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137573.809159:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990137984:12345-0@lo:400:kworker.0 Request processed in 76us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137573.809167:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1783137573.809339:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137573.809379:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1783137573.809385:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1783137573.809406:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709b7eb3b80, transno 4294967301 00000004:00080000:1.0:1783137573.809424:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1783137573.809437:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709b7caaa00, transno 4294967304 00000100:00100000:1.0:1783137573.809444:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990137984:0@lo:400:kworker.0 00000100:00100000:0.0:1783137573.809766:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990137472 00000100:00100000:0.0:1783137573.809772:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990137472 00000100:00100000:0.0:1783137573.810023:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783137573.810035:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990137472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137573.810098:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990137472:12345-0@lo:400:kworker.0 Request processed in 65us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137573.810104:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783137573.810185:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990137472:0@lo:400:kworker.0 00000100:00100000:1.0:1783137574.319492:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137574.319512:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990138112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137574.319573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137574.319631:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990138112 00000100:00100000:1.0:1783137574.319637:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990138112 00000100:00100000:1.0:1783137574.319678:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783137574.319687:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990138112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137574.319721:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137574.319763:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990138112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137574.319770:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783137574.319833:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990138112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783137574.374980:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137574.823289:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990138240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137574.823361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137574.824009:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990138240 00000100:00100000:2.0:1783137574.824017:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990138240 00000100:00100000:2.0:1783137574.824065:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783137574.824074:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1869754990138240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137574.824114:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137574.824168:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1869754990138240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137574.824184:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783137574.824603:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990138240:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1783137574.876632:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1783137574.876651:0:5836:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9709bc952cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1783137574.876656:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff97098730ad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9709bc952b40 00000020:00080000:2.0:1783137574.876659:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff97098730a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff970989b78000 00000020:00080000:2.0:1783137574.876684:0:5836:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1783137574.876704:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1783137574.876941:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1783137574.877172:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1783137574.887488:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1783137574.887504:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:2.0:1783137575.400021:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137576.251184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137576.251232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137576.251270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137576.251375:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974401280 00000100:00100000:0.0:1783137576.251397:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974401280 00000100:00100000:0.0:1783137576.251455:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 136 00000100:00100000:0.0:1783137576.251465:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2352:x1869754974401280:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137576.251535:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2352:x1869754974401280:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137576.251543:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 136 00000100:00100000:1.0:1783137576.252040:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974401536 00000100:00100000:1.0:1783137576.252046:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974401536 00000100:00100000:1.0:1783137576.252090:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:1.0:1783137576.252108:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974401536:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137576.252147:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974401536:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 41us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137576.252154:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00080000:1.0:1783137576.252172:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137576.252176:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137576.252729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137576.252776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137576.253265:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974401408 00000100:00100000:1.0:1783137576.253272:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974401408 00000100:00100000:1.0:1783137576.253325:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:1.0:1783137576.253333:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974401408:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137576.253386:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974401408:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 53us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137576.253393:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00080000:1.0:1783137576.253415:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137576.253770:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974401664 00000100:00100000:3.0:1783137576.253775:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974401664 00000100:00080000:1.0:1783137576.254063:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137576.254110:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 137 00000100:00100000:3.0:1783137576.254120:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974401664:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137576.254170:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974401664:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 52us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137576.254177:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 137 00000100:00100000:2.0:1783137576.254881:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974401152 00000100:00100000:2.0:1783137576.254889:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974401152 00000100:00100000:2.0:1783137576.254925:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 288 00000100:00100000:2.0:1783137576.254932:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974401152:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137576.254975:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974401152:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 44us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137576.254983:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 288 00010000:00010000:0.0:1783137576.423051:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137577.447013:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137577.623999:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137577.624566:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974401792 00000100:00100000:0.0:1783137577.624575:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974401792 00000100:00100000:0.0:1783137577.624637:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 135 00000100:00100000:0.0:1783137577.624649:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:10228:x1869754974401792:12345-192.168.203.36@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783137577.624753:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:10228:x1869754974401792:12345-192.168.203.36@tcp:60:lhsmtool_posix.0 Request processed in 106us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137577.624762:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 135 00000100:00100000:2.0:1783137577.636206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137577.636630:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974402048 00000100:00100000:1.0:1783137577.636641:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974402048 00000100:00100000:1.0:1783137577.636714:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:1.0:1783137577.636724:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:10228:x1869754974402048:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783137577.637504:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:10228:x1869754974402048:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 777us (1302us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1783137577.637516:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:1.0:1783137577.896718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137577.896832:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974402176 00000100:00100000:0.0:1783137577.896842:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974402176 00000100:00100000:0.0:1783137577.896943:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 136 00000100:00100000:0.0:1783137577.896954:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+5:11026:x1869754974402176:12345-192.168.203.36@tcp:101:lsof.0 00010000:00010000:0.0:1783137577.896974:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137577.896994:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac67528f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72996 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137577.897056:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137577.897071:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137577.897113:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137577.897429:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783137577.897434:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137577.897554:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137577.897582:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac67528f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72996 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137577.897599:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72996 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137577.897608:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:0.0:1783137577.897611:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137577.897614:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234c00, rc 0) 00000100:00100000:0.0:1783137577.897693:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+6:11026:x1869754974402176:12345-192.168.203.36@tcp:101:lsof.0 Request processed in 741us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137577.897701:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 136 00010000:00010000:2.0:1783137578.472097:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137578.919710:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990138368:0@lo:400:kworker.0 00000100:00100000:3.0:1783137578.919782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137578.919854:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990138880:0@lo:400:kworker.0 00000100:00100000:3.0:1783137578.919881:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137578.919904:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783137578.919910:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990138496:0@lo:400:kworker.0 00000100:00100000:3.0:1783137578.919929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137578.919948:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990139008:0@lo:400:kworker.0 00000100:00100000:3.0:1783137578.919969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137578.919996:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990138368 00000100:00100000:3.0:1783137578.920002:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990138368 00000100:00100000:3.0:1783137578.920041:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1783137578.920049:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990138368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137578.920119:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987368050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990138368:12345-0@lo:400:kworker.0 Request processed in 70us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137578.920126:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1783137578.920155:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990138880 00000100:00100000:3.0:1783137578.920158:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990138880 00000100:00100000:3.0:1783137578.920185:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990138496 00000100:00100000:3.0:1783137578.920188:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990138496 00000100:00100000:3.0:1783137578.920205:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783137578.920211:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990138880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137578.920240:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990138880:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137578.920246:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783137578.920258:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783137578.920263:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990138496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137578.920287:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990138496:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137578.920299:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783137578.920339:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990138496:0@lo:400:kworker.0 00000100:00100000:3.0:1783137578.920348:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990138368:0@lo:400:kworker.0 00000100:00100000:3.0:1783137578.920356:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990138880:0@lo:400:kworker.0 00000100:00100000:2.0:1783137578.920459:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990138752:0@lo:400:kworker.0 00000100:00100000:2.0:1783137578.920488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137578.920729:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990138624:0@lo:400:kworker.0 00000100:00100000:0.0:1783137578.920760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137578.920894:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990139008 00000100:00100000:1.0:1783137578.920900:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990139008 00000100:00100000:1.0:1783137578.920936:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990138752 00000100:00100000:1.0:1783137578.920939:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990138752 00000100:00100000:1.0:1783137578.920961:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783137578.920968:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990139008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137578.921009:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990139008:12345-0@lo:400:kworker.0 Request processed in 41us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137578.921015:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783137578.921027:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783137578.921032:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990138752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137578.921073:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990138752:12345-0@lo:400:kworker.0 Request processed in 40us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137578.921088:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1783137578.921103:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137578.921106:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137578.921108:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137578.921140:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990139008:0@lo:400:kworker.0 00000100:00100000:2.0:1783137578.921266:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1783137578.921271:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709894e4700, transno 4294967310 00000004:00080000:2.0:1783137578.921288:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1783137578.921303:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990138752:0@lo:400:kworker.0 00000100:00100000:2.0:1783137578.921330:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990138624 00000100:00100000:2.0:1783137578.921333:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990138624 00000100:00100000:2.0:1783137578.921361:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783137578.921366:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990138624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137578.921399:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990138624:12345-0@lo:400:kworker.0 Request processed in 33us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137578.921406:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783137578.921595:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990138624:0@lo:400:kworker.0 00000100:00080000:1.0:1783137578.922430:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137579.431347:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137579.431373:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990139136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137579.431456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137579.431674:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990139136 00000100:00100000:1.0:1783137579.431682:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990139136 00000100:00100000:1.0:1783137579.431746:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783137579.431756:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990139136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137579.431789:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137579.431866:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990139136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137579.431889:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783137579.432247:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990139136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137579.494984:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137579.943358:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137579.943381:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990139264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137579.943445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137579.943507:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990139264 00000100:00100000:1.0:1783137579.943518:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990139264 00000100:00100000:1.0:1783137579.943568:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783137579.943582:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990139264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137579.943630:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137579.943681:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990139264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137579.943688:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783137579.945880:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990139264:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1783137580.027250:0:5836:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1783137580.027277:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1783137580.027375:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1783137580.027387:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:3.0:1783137580.202339:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137580.202350:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137580.202736:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:3.0:1783137580.202743:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783137580.519516:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783137581.266690:0:12200:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:59:39 (1783137579) 00000100:00100000:2.0:1783137581.378344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137581.378379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137581.378415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137581.378439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137581.378463:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137581.378492:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974402816 00000100:00100000:2.0:1783137581.378501:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974402816 00000100:00100000:2.0:1783137581.378545:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974402432 00000100:00100000:2.0:1783137581.378548:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974402432 00000100:00100000:2.0:1783137581.378569:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:2.0:1783137581.378578:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2352:x1869754974402816:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137581.378646:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2352:x1869754974402816:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 69us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137581.378669:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:2.0:1783137581.378688:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:2.0:1783137581.378694:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2352:x1869754974402432:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137581.378720:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2352:x1869754974402432:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137581.378726:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:2.0:1783137581.378745:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974402560 00000100:00100000:2.0:1783137581.378748:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974402560 00000100:00100000:2.0:1783137581.378770:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974402688 00000100:00100000:2.0:1783137581.378773:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974402688 00000100:00100000:2.0:1783137581.378823:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:2.0:1783137581.378830:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974402560:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137581.378856:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974402560:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137581.378863:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:2.0:1783137581.378874:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:2.0:1783137581.378880:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974402688:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137581.378901:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974402688:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 21us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137581.378907:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:1.0:1783137581.379236:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974402304 00000100:00100000:1.0:1783137581.379241:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974402304 00000100:00100000:1.0:1783137581.379269:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 290 00000100:00100000:1.0:1783137581.379276:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974402304:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137581.379309:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974402304:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 34us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137581.379316:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 290 00000100:00080000:1.0:1783137581.379341:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137581.379345:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137581.379347:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137581.544462:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137582.568093:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137582.765659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137582.767586:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974403072 00000100:00100000:3.0:1783137582.767599:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974403072 00000100:00100000:3.0:1783137582.767717:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 137 00000100:00100000:3.0:1783137582.767729:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:11292:x1869754974403072:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137582.767757:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137582.767776:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac67529d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec7299d expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.768255:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.768289:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.768300:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.768374:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.768383:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.768389:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769124:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac6752b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769135:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac6752b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769143:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac6752b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137582.769153:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1783137582.769346:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769355:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769363:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769376:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137582.769381:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769389:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769402:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff970987960d00) 00010000:00010000:3.0:1783137582.769405:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137582.769409:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769415:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac6752a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769427:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769433:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769438:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769442:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137582.769445:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769450:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769480:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff970987960100) 00010000:00010000:3.0:1783137582.769483:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137582.769486:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.769492:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac6752ab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.773544:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac67529d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7299d expref: 16 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.773573:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac6752b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7299d expref: 15 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137582.773582:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:3.0:1783137582.773585:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137582.773589:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005400, rc 0) 00000100:00100000:3.0:1783137582.773662:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:11292:x1869754974403072:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 5935us (8012us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1783137582.773671:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 137 00000100:00100000:1.0:1783137582.782939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137582.783032:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974403200 00000100:00100000:0.0:1783137582.783042:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974403200 00000100:00100000:0.0:1783137582.783128:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:0.0:1783137582.783138:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:2351:x1869754974403200:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137582.783154:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137582.783177:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005400/0x88def104ac6752b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7299d expref: 15 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137582.783196:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:0.0:1783137582.783200:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137582.783256:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:2351:x1869754974403200:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 118us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137582.783263:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1783137582.786505:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137582.786599:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974403328 00000100:00100000:2.0:1783137582.786609:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974403328 00000100:00100000:2.0:1783137582.786669:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 138 00000100:00100000:2.0:1783137582.786694:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:11292:x1869754974403328:12345-192.168.203.36@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783137582.786847:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:11292:x1869754974403328:12345-192.168.203.36@tcp:59:lhsmtool_posix.0 Request processed in 154us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137582.786856:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 138 00000040:00080000:2.0:1783137583.272159:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137583.272169:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137583.272549:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:2.0:1783137583.272557:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783137583.593550:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137584.042973:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990139392:0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.042996:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990139520:0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.048380:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137584.048818:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990140032:0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.048864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137584.048893:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990139520 00000100:00100000:0.0:1783137584.048905:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137584.048907:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990139520 00000100:00100000:0.0:1783137584.048912:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990139904:0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.048934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137584.048983:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990140032 00000100:00100000:3.0:1783137584.048989:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990140032 00000100:00100000:3.0:1783137584.049030:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783137584.049048:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990140032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137584.049288:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990140032:12345-0@lo:400:kworker.0 Request processed in 249us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137584.049297:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783137584.052659:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990139904 00000100:00100000:1.0:1783137584.052674:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990139904 00000100:00100000:1.0:1783137584.052751:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783137584.052764:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990139520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137584.057679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137584.057828:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990139392 00000100:00100000:2.0:1783137584.057836:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990139392 00000100:00100000:2.0:1783137584.057885:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1783137584.057895:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990139392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137584.057951:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990139392:12345-0@lo:400:kworker.0 Request processed in 58us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137584.057958:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1783137584.058021:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990139392:0@lo:400:kworker.0 00000100:00080000:2.0:1783137584.058077:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783137584.058083:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783137584.061912:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783137584.061932:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990139904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137584.062012:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990139904:12345-0@lo:400:kworker.0 Request processed in 89us (13077us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137584.062019:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783137584.062810:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990139904:0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.062830:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990140032:0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.062869:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990139648:0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.062907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137584.062934:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137584.062942:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990139776:0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.062977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137584.063015:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990139648 00000100:00100000:0.0:1783137584.063021:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990139648 00000100:00100000:0.0:1783137584.063072:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783137584.063079:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990139648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.063119:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990139648:12345-0@lo:400:kworker.0 Request processed in 40us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137584.063127:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783137584.063148:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990139776 00000100:00100000:0.0:1783137584.063151:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990139776 00000100:00100000:0.0:1783137584.063175:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783137584.063181:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.063211:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990139776:12345-0@lo:400:kworker.0 Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137584.063217:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1783137584.063231:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137584.063234:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137584.063252:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990139776:0@lo:400:kworker.0 00000100:00100000:0.0:1783137584.063263:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990139648:0@lo:400:kworker.0 00000100:00100000:1.0:1783137584.067084:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990139520:12345-0@lo:400:kworker.0 Request processed in 14315us (18701us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137584.067100:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783137584.070651:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990139520:0@lo:400:kworker.0 00000100:00100000:1.0:1783137584.550961:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783137584.550983:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709897ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990140160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137584.551058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137584.551113:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990140160 00000100:00100000:1.0:1783137584.551120:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990140160 00000100:00100000:1.0:1783137584.551161:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783137584.551169:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990140160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137584.551201:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137584.551261:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990140160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137584.551268:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783137584.551315:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709897ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990140160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137584.616779:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137584.811117:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137584.811159:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974403456 00000100:00100000:0.0:1783137584.811168:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974403456 00000100:00080000:2.0:1783137584.811232:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137584.811240:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 139 00000100:00100000:0.0:1783137584.811251:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:11334:x1869754974403456:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137584.811270:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137584.811298:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729a4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811357:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811371:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811381:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811395:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811402:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811409:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811708:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811717:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811724:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811730:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137584.811733:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811752:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811764:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:0.0:1783137584.811767:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137584.811772:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811779:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6752c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811921:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811929:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811935:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.811941:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137584.812149:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.812156:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.812165:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9709860f4000) 00010000:00010000:0.0:1783137584.812167:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137584.812170:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.812185:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac6752ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.812220:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729a4 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.812230:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:0.0:1783137584.812233:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137584.812238:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729a4 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.812248:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235000, rc 0) 00000100:00100000:0.0:1783137584.812312:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:11334:x1869754974403456:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1062us (1203us total) trans 0 rc 301/301 00000100:00100000:0.0:1783137584.812320:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 139 00000100:00100000:1.0:1783137584.822306:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137584.822440:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974403712 00000100:00100000:0.0:1783137584.822449:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974403712 00000100:00100000:0.0:1783137584.822532:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 140 00000100:00100000:0.0:1783137584.822543:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:11334:x1869754974403712:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:0.0:1783137584.822595:0:7113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137584.822622:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac674c3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727dd expref: 14 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.822639:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:0.0:1783137584.822645:0:7113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137584.822954:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.822985:0:7113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72996 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.822998:0:7113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.823031:0:7113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72996 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.823053:0:7113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72996 expref: 5 pid: 5815 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137584.823068:0:7113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990140288:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137584.823153:0:7113:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783137584.829984:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137584.830091:0:7113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990140288:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137584.830095:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974403840 00000100:00100000:3.0:1783137584.830114:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974403840 00010000:00010000:0.0:1783137584.830120:0:7113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.830166:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72996 expref: 6 pid: 5815 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137584.830205:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:3.0:1783137584.830215:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2352:x1869754974403840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137584.830229:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137584.830236:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72996 expref: 6 pid: 5815 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.830257:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72996 expref: 6 pid: 5815 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.830279:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675296 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72996 expref: 6 pid: 5815 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.830293:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:3.0:1783137584.830297:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.830306:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.830323:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.830354:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137584.830400:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974403840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 185us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137584.830408:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00080000:3.0:1783137584.830431:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783137584.830712:0:7113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.830722:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.830744:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.830754:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.830768:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137584.833530:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783137584.833548:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.833557:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.833564:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.833570:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137584.833575:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.833583:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.833598:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987960a00) 00010000:00010000:0.0:1783137584.833602:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137584.833606:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.833611:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac6752d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137584.833628:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001eb26b1d reply state 000000009c09cacb transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137584.833649:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137584.833759:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:11334:x1869754974403712:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 11214us (11454us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783137584.833767:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 140 00010000:00010000:2.0:1783137584.836740:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.836755:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.837158:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.837164:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137584.837168:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.837175:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.837190:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9709860f4000) 00010000:00010000:2.0:1783137584.837194:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137584.837198:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.837204:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235000/0x88def104ac6752dc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137584.914149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137584.917683:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974403968 00000100:00100000:0.0:1783137584.917697:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974403968 00000100:00100000:2.0:1783137584.919615:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:2.0:1783137584.919627:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+14:11342:x1869754974403968:12345-192.168.203.36@tcp:101:lctl.0 00010000:00010000:2.0:1783137584.919651:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137584.919673:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6752e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729ab expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.919736:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6752ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.919749:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6752ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.919787:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6752ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137584.920171:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783137584.920175:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137584.920200:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6752ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.920225:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6752e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ab expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.920241:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6752ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ab expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.920250:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98500) 00010000:00010000:2.0:1783137584.920253:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137584.920256:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050400, rc 0) 00000100:00100000:2.0:1783137584.920327:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:11342:x1869754974403968:12345-192.168.203.36@tcp:101:lctl.0 Request processed in 702us (6187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137584.920348:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 141 00000100:00100000:1.0:1783137584.966916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137584.967173:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974404096 00000100:00100000:2.0:1783137584.967184:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974404096 00000100:00100000:2.0:1783137584.967241:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:2.0:1783137584.967251:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+15:11349:x1869754974404096:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1783137584.967271:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137584.967407:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6752f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729b2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967486:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967500:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967510:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967525:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967532:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967539:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967711:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675306 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967720:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967726:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137584.967759:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1783137584.967772:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137584.967826:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967850:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967857:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967864:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967870:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137584.967874:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967881:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967893:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98500) 00010000:00010000:2.0:1783137584.967896:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137584.967901:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967907:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6752f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967921:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967927:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967932:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967943:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137584.967945:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967952:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967960:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff970990e98f00) 00010000:00010000:2.0:1783137584.967962:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137584.967965:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.967970:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6752ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.968013:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6752f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b2 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.968026:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b2 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137584.968045:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:2.0:1783137584.968048:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783137584.968050:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051e00, rc 0) 00000100:00100000:2.0:1783137584.968116:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:11349:x1869754974404096:12345-192.168.203.36@tcp:101:bash.0 Request processed in 866us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137584.968123:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 142 00000100:00100000:0.0:1783137584.975299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137584.975436:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974404352 00000100:00100000:3.0:1783137584.975445:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974404352 00000100:00100000:3.0:1783137584.975499:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 143 00000100:00100000:3.0:1783137584.975508:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:11349:x1869754974404352:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:3.0:1783137584.975527:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137584.975545:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac67530d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729b9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.975671:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.975685:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.975696:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.975760:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.975768:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.975788:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783137584.976500:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1783137584.976658:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976669:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976677:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976709:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976716:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976724:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976730:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137584.976734:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976740:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976751:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:3.0:1783137584.976755:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137584.976767:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976774:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675314 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137584.976787:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e750e3d reply state 000000008fb717e7 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137584.976928:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783137584.976959:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac67530d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b9 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976973:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b9 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.976980:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970987960c00) 00010000:00010000:3.0:1783137584.976982:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137584.976984:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004c00, rc 0) 00000100:00100000:3.0:1783137584.977061:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:11349:x1869754974404352:12345-192.168.203.36@tcp:101:bash.0 Request processed in 1553us (1780us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1783137584.977069:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 143 00010000:00010000:0.0:1783137584.981175:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.981192:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.981199:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.981206:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137584.981211:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.981218:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.981236:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970987960100) 00010000:00010000:0.0:1783137584.981238:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137584.981243:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137584.981250:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac67531b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137584.988557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137584.988619:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974404480 00000100:00100000:3.0:1783137584.988629:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974404480 00000100:00100000:3.0:1783137584.988756:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:3.0:1783137584.988771:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2354:x1869754974404480:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:3.0:1783137584.988816:0:6620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137584.988837:0:6620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729c0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137584.988881:0:6620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137584.988900:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783137584.988905:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137584.988916:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c0 expref: 6 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.988935:0:6620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c0 expref: 6 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137584.988948:0:6620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004a00, rc 0) 00000100:00080000:2.0:1783137584.989088:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137584.989108:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2354:x1869754974404480:12345-192.168.203.36@tcp:101:bash.0 Request processed in 331us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137584.989118:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:1.0:1783137584.992710:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137584.993025:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974404608 00000100:00100000:0.0:1783137584.993043:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974404608 00000100:00100000:1.0:1783137584.993323:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:1.0:1783137584.993346:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:11349:x1869754974404608:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1783137584.993364:0:8200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137584.993381:0:8200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729c7 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137584.993411:0:8200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c0 expref: 7 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137584.993420:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137584.993423:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137584.993428:0:8200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 7 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137584.993460:0:8200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c0 expref: 7 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137584.993473:0:8200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c0 expref: 7 pid: 6620 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137584.993486:0:8200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b18d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8200:1869754990140416:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137584.993577:0:8200:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab290180 going to sleep for 11 seconds 00000100:00100000:3.0:1783137585.003564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.003774:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974404736 00000100:00100000:0.0:1783137585.003783:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974404736 00010000:00010000:0.0:1783137585.003855:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c0 expref: 8 pid: 6620 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.003891:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:0.0:1783137585.003900:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974404736:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137585.003916:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137585.003937:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c0 expref: 8 pid: 6620 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.003952:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c0 expref: 8 pid: 6620 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.003978:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137585.003982:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137585.003991:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 8 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.004002:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 8 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.004049:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 8 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.004078:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1869754990140544:192.168.203.36@tcp:105: 00000100:00100000:0.0:1783137585.004315:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a240 going to sleep for 11 seconds 00010000:00010000:1.0:1783137585.004600:0:8200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675330 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c0 expref: 8 pid: 6620 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137585.004616:0:8200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b18d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8200:1869754990140416:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137585.004650:0:8200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 7 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137585.004661:0:8200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c800, rc 0) 00000100:00100000:1.0:1783137585.004705:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:11349:x1869754974404608:12345-192.168.203.36@tcp:101:bash.0 Request processed in 11360us (12003us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137585.004712:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:3.0:1783137585.011063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.012779:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1869754990140544:192.168.203.36@tcp:105: 00010000:00010000:0.0:1783137585.012843:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137585.012902:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974404736:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 9002us (9348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137585.012912:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:2.0:1783137585.015463:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974404992 00000100:00100000:2.0:1783137585.015477:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974404992 00000100:00100000:2.0:1783137585.015593:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:2.0:1783137585.015604:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:11349:x1869754974404992:12345-192.168.203.36@tcp:35:bash.0 00000100:00100000:2.0:1783137585.015982:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:11349:x1869754974404992:12345-192.168.203.36@tcp:35:bash.0 Request processed in 378us (4927us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1783137585.015990:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:2.0:1783137585.063561:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990140672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137585.063624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137585.066403:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990140672 00000100:00100000:3.0:1783137585.066426:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990140672 00000100:00100000:3.0:1783137585.066486:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783137585.066497:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990140672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137585.066533:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137585.066611:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990140672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137585.066618:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783137585.067135:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bf237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990140672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137585.111993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.112912:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974405248 00000100:00100000:2.0:1783137585.112921:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974405248 00000100:00100000:2.0:1783137585.112980:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 144 00000100:00100000:2.0:1783137585.112989:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:11359:x1869754974405248:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137585.113012:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137585.113038:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67533e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137585.113281:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1783137585.113617:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67533e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ce expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.113631:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98500) 00010000:00010000:2.0:1783137585.113633:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137585.113638:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67533e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ce expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.113662:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051000, rc 0) 00000100:00100000:2.0:1783137585.113787:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:11359:x1869754974405248:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 798us (1801us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1783137585.113839:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 144 00000001:00080000:2.0:1783137585.114585:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000001:00080000:2.0:1783137585.114598:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967419 is committed 00000100:00100000:0.0:1783137585.123639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.123710:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974405504 00000100:00100000:2.0:1783137585.123721:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974405504 00000100:00100000:2.0:1783137585.123786:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:2.0:1783137585.123822:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+16:11359:x1869754974405504:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137585.124284:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:11359:x1869754974405504:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 463us (653us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1783137585.124292:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:1.0:1783137585.188527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.188696:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974405632 00000100:00100000:2.0:1783137585.188706:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974405632 00000100:00100000:2.0:1783137585.188772:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 145 00000100:00100000:2.0:1783137585.188784:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:11365:x1869754974405632:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137585.188841:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137585.188862:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67534c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729d5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.188923:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675353 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.188935:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.188960:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137585.189157:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783137585.189162:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137585.189243:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.189269:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67534c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729d5 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.189292:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729d5 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.189300:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:2.0:1783137585.189303:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137585.189306:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050200, rc 0) 00000100:00100000:2.0:1783137585.189354:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:11365:x1869754974405632:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 572us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137585.189361:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 145 00000100:00100000:1.0:1783137585.194991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.195074:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974405888 00000100:00100000:2.0:1783137585.195083:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974405888 00000100:00100000:2.0:1783137585.195147:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:2.0:1783137585.195156:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:11365:x1869754974405888:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137585.195174:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137585.195195:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67535a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.195325:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675361 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.195341:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.195352:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137585.195364:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783137585.195488:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67535a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729dc expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.195507:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729dc expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.195516:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970987960c00) 00010000:00010000:2.0:1783137585.195519:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137585.195523:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051200, rc 0) 00000100:00100000:2.0:1783137585.195621:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:11365:x1869754974405888:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 465us (639us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1783137585.195629:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:0.0:1783137585.201220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.201270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.201312:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974406144 00000100:00100000:2.0:1783137585.201321:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974406144 00000100:00100000:3.0:1783137585.201335:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974406272 00000100:00100000:3.0:1783137585.201339:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974406272 00000100:00100000:3.0:1783137585.201379:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:2.0:1783137585.201379:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 147 00000100:00100000:3.0:1783137585.201388:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:2354:x1869754974406272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783137585.201388:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:11365:x1869754974406144:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137585.201408:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137585.201414:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137585.201437:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac67536f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729e3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.201445:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675361 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729dc expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.201460:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970987960c00) 00010000:00010000:3.0:1783137585.201464:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137585.201508:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:2354:x1869754974406272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 122us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137585.201515:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00010000:00010000:2.0:1783137585.201523:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675376 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.201535:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.201546:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137585.201558:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783137585.201668:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac67536f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729e3 expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.201682:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675376 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729e3 expref: 21 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.201836:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970987960c00) 00010000:00010000:2.0:1783137585.201840:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783137585.201842:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050600, rc 0) 00000100:00100000:2.0:1783137585.201867:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:11365:x1869754974406144:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 480us (657us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1783137585.201874:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 147 00000100:00100000:1.0:1783137585.217586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.218087:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974406400 00000100:00100000:2.0:1783137585.218097:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974406400 00000100:00100000:2.0:1783137585.218153:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:2.0:1783137585.218163:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2352:x1869754974406400:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1783137585.218221:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.218239:0:6620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 6 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.218248:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783137585.218252:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137585.218257:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.218297:0:6620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 6 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.218310:0:6620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 6 pid: 8200 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137585.218324:0:6620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd26c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6620:1869754990140800:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137585.218411:0:6620:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137585.230887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.231509:0:6620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd26c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6620:1869754990140800:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137585.231535:0:6620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.232361:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974406528 00000100:00100000:0.0:1783137585.232370:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974406528 00002000:00100000:0.0:1783137585.232421:0:6625:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9709b18d1180 x1869754974406528/t0(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:491/0 lens 504/0 e 0 to 0 dl 1783137596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137585.232433:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709b18d1180 with x1869754974406528 ext(0->12) 00010000:00010000:0.0:1783137585.232441:0:6625:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 7 pid: 8200 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.232455:0:6625:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 7 pid: 8200 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783137585.232464:0:6625:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9709b18d1180 00000100:00100000:0.0:1783137585.232495:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:0.0:1783137585.232504:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2351:x1869754974406528:12345-192.168.203.36@tcp:4:lfs.0 00000100:00100000:0.0:1783137585.233186:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2351:x1869754974406528:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 681us (2307us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783137585.233194:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00002000:00100000:0.0:1783137585.233201:0:6625:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9709b18d1180 x1869754974406528/t4294967305(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:491/0 lens 504/448 e 0 to 0 dl 1783137596 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783137585.233210:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709b18d1180 with x1869754974406528 ext(0->12) 00010000:00010000:0.0:1783137585.233216:0:6625:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 9 pid: 8200 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.233229:0:6625:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 9 pid: 8200 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783137585.233236:0:6625:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9709b18d1180 00000100:00100000:0.0:1783137585.245757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.245882:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974406656 00000100:00100000:2.0:1783137585.245892:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974406656 00010000:00010000:2.0:1783137585.245932:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 9 pid: 8200 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137585.245981:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:2.0:1783137585.245991:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2352:x1869754974406656:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137585.246005:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783137585.246025:0:5800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783137585.246027:0:5800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783137584 00002000:00010000:2.0:1783137585.246041:0:5800:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783137584 00002000:00010000:2.0:1783137585.246043:0:5800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783137584 00010000:00010000:2.0:1783137585.246049:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 9 pid: 8200 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.246064:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 9 pid: 8200 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.246091:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac675337 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729c7 expref: 9 pid: 8200 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.246119:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137585.246123:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137585.246129:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.246137:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.246160:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137585.246223:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974406656:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 233us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137585.246231:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00010000:00010000:1.0:1783137585.246553:0:6620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137585.246564:0:6620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137585.246587:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137585.246595:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137585.246602:0:6620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137585.246621:0:6620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137585.246625:0:6620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137585.246633:0:6620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137585.246646:0:6620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137585.246653:0:6620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675384 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137585.246704:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974406400:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 28542us (29128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137585.246712:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:1.0:1783137585.252054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.252220:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974406912 00000100:00100000:0.0:1783137585.252230:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974406912 00000100:00100000:0.0:1783137585.252294:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:0.0:1783137585.252303:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:11365:x1869754974406912:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:0.0:1783137585.252366:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675376 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729e3 expref: 21 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137585.252618:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1783137585.252665:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1783137585.253328:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1783137585.253386:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.253410:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b9 expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.253418:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.253451:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b9 expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.253465:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b9 expref: 25 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.253480:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1869754990140928:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137585.253564:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783137585.261501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137585.262141:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974407040 00000100:00100000:3.0:1783137585.262152:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974407040 00010000:00010000:3.0:1783137585.262191:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b9 expref: 26 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137585.262234:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:3.0:1783137585.262564:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:2352:x1869754974407040:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137585.262584:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137585.262592:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b9 expref: 26 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.262606:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b9 expref: 26 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.262627:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970987960c00) 00010000:00010000:3.0:1783137585.262632:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.262658:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.262666:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.262687:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137585.262909:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac675322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b9 expref: 26 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.262927:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1869754990140928:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137585.262947:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.262955:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.262960:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137585.263085:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1783137585.263376:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1783137585.263771:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:2352:x1869754974407040:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1518us (2269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137585.263781:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:0.0:1783137585.264071:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990141056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783137585.264184:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137585.264223:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a000 going to sleep for 11 seconds 00000100:00100000:3.0:1783137585.264631:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990141056 00000100:00100000:3.0:1783137585.264638:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990141056 00000100:00100000:3.0:1783137585.264681:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783137585.264689:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1869754990141056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783137585.264815:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1869754990141056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 103us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137585.264822:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783137585.266519:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990141056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783137585.267645:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1783137585.267725:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990141184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783137585.268348:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137585.268389:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b0bb300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137585.268864:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990141184 00000100:00100000:3.0:1783137585.268872:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990141184 00000100:00100000:3.0:1783137585.268922:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783137585.268932:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1869754990141184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783137585.269138:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1869754990141184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 207us (790us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783137585.269146:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137585.270003:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990141184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783137585.270089:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1783137585.270138:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.270149:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.270157:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.270164:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137585.270169:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.270176:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.270191:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970987960c00) 00010000:00010000:0.0:1783137585.270194:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783137585.270213:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.270220:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67538b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137585.270620:0:5818:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783137585.270714:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1783137585.271391:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341168597626ns, next at 342167930557ns, rc = 0 00000001:00080000:0.0:1783137585.271402:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1783137585.271553:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970987960c00) 00010000:00010000:0.0:1783137585.271557:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783137585.271566:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675376 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729e3 expref: 29 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.271668:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:11365:x1869754974406912:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 19364us (19623us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1783137585.271677:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00000020:00080000:0.0:1783137585.271683:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783137585.283398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.289342:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974407168 00000100:00100000:2.0:1783137585.289356:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974407168 00000100:00100000:2.0:1783137585.289480:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 148 00000100:00100000:2.0:1783137585.289491:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:11365:x1869754974407168:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137585.289515:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137585.289537:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675392 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.289592:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675392 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ea expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.289608:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675392 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ea expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.289626:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137585.289630:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137585.289633:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051000, rc 0) 00000100:00100000:2.0:1783137585.289700:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:11365:x1869754974407168:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 211us (6312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137585.289707:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 148 00000100:00100000:1.0:1783137585.297749:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137585.297952:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974407424 00000100:00100000:3.0:1783137585.297960:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974407424 00000100:00100000:3.0:1783137585.298018:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:3.0:1783137585.298049:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:11365:x1869754974407424:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1783137585.298273:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:11365:x1869754974407424:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 225us (533us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1783137585.298281:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:1.0:1783137585.421867:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.421923:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974407680 00000100:00100000:2.0:1783137585.421934:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974407680 00000100:00100000:2.0:1783137585.421996:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 149 00000100:00100000:2.0:1783137585.422006:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+30:11375:x1869754974407680:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137585.422060:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137585.422080:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729f1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137585.423734:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783137585.426970:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675399 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f1 expref: 32 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.426992:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98500) 00010000:00010000:3.0:1783137585.426995:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137585.427001:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f1 expref: 32 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.427018:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050e00, rc 0) 00000100:00100000:3.0:1783137585.427935:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:11375:x1869754974407680:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 5093us (5238us total) trans 4294967434 rc 301/301 00000100:00100000:3.0:1783137585.427946:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 149 00000100:00100000:1.0:1783137585.430434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.430526:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974407808 00000100:00100000:0.0:1783137585.430536:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974407808 00000100:00100000:0.0:1783137585.430589:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 150 00000100:00100000:0.0:1783137585.430599:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:11375:x1869754974407808:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:0.0:1783137585.430660:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.430672:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.430679:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.430714:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.430720:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.430733:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.430982:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.430989:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.430993:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137585.431026:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431049:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431056:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431064:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431069:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137585.431073:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431089:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431102:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137585.431105:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137585.431109:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431115:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431127:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431134:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431139:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431144:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137585.431146:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431151:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431158:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9709860f4b00) 00010000:00010000:0.0:1783137585.431160:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137585.431162:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431178:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431192:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431198:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431204:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431209:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137585.431211:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431218:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431226:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137585.431228:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137585.431230:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.431236:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.431303:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:11375:x1869754974407808:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 704us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137585.431312:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 150 00000100:00100000:1.0:1783137585.437107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137585.437171:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974408064 00000100:00100000:3.0:1783137585.437181:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974408064 00000100:00100000:3.0:1783137585.437238:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:3.0:1783137585.437248:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:11375:x1869754974408064:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1783137585.438186:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:11375:x1869754974408064:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 935us (1082us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1783137585.438195:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:1.0:1783137585.474392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.474478:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974408320 00000100:00100000:0.0:1783137585.474486:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974408320 00000100:00100000:0.0:1783137585.474535:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:0.0:1783137585.474543:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:11378:x1869754974408320:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137585.474565:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137585.474582:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729f8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.474645:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.474659:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.474670:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.474682:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.474689:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.474695:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475022:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475042:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475060:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137585.475070:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783137585.475144:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475152:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475158:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475163:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137585.475167:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475174:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475184:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137585.475187:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137585.475190:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475196:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6753c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475207:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475213:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475224:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475229:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137585.475232:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475237:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475244:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9709860f4b00) 00010000:00010000:0.0:1783137585.475246:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137585.475248:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475253:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475287:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f8 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475299:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f8 expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.475306:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137585.475308:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137585.475310:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235200, rc 0) 00000100:00100000:0.0:1783137585.475363:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:11378:x1869754974408320:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 821us (979us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1783137585.475380:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:0.0:1783137585.481537:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.481724:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974408448 00000100:00100000:2.0:1783137585.481735:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974408448 00000100:00100000:0.0:1783137585.481991:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 152 00000100:00100000:0.0:1783137585.482004:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:11378:x1869754974408448:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:0.0:1783137585.482078:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.482095:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.482105:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.482129:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.482135:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.482142:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.482148:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137585.482152:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.482159:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.482169:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137585.482184:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137585.482189:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.482195:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.482266:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:11378:x1869754974408448:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 265us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137585.482274:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 152 00000100:00100000:2.0:1783137585.485048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.485128:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974408704 00000100:00100000:0.0:1783137585.485139:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974408704 00000100:00100000:0.0:1783137585.485190:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:0.0:1783137585.485199:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:11378:x1869754974408704:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137585.485410:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:11378:x1869754974408704:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 210us (389us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1783137585.485418:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00010000:00010000:3.0:1783137585.641511:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783137585.651425:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1783137585.651457:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1783137585.754553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.754669:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974408960 00000100:00100000:0.0:1783137585.754678:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974408960 00000100:00100000:0.0:1783137585.754739:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 153 00000100:00100000:0.0:1783137585.754748:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:11409:x1869754974408960:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1783137585.754781:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137585.754830:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec729ff expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.754923:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.754937:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.754954:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137585.754967:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783137585.755103:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ff expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.755121:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ff expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.755129:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137585.755132:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137585.755135:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235e00, rc 0) 00000100:00100000:0.0:1783137585.755192:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:11409:x1869754974408960:12345-192.168.203.36@tcp:101:cat.0 Request processed in 445us (648us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1783137585.755200:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 153 00000100:00100000:1.0:1783137585.760994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137585.761311:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137585.761478:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974409344 00000100:00100000:2.0:1783137585.761488:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974409344 00000100:00100000:2.0:1783137585.761550:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:2.0:1783137585.761560:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:2354:x1869754974409344:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137585.761575:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137585.761597:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6753ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ff expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.761613:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137585.761617:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137585.761662:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:2354:x1869754974409344:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 105us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137585.761669:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:0.0:1783137585.762058:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974409216 00000100:00100000:0.0:1783137585.762063:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974409216 00000100:00100000:0.0:1783137585.762178:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:0.0:1783137585.762189:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:11409:x1869754974409216:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1783137585.762395:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:11409:x1869754974409216:12345-192.168.203.36@tcp:35:cat.0 Request processed in 207us (1410us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1783137585.764149:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:1.0:1783137585.822957:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.823020:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974409600 00000100:00100000:0.0:1783137585.823039:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974409600 00000100:00100000:0.0:1783137585.823098:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 154 00000100:00100000:0.0:1783137585.823108:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:11415:x1869754974409600:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:0.0:1783137585.823143:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137585.823146:0:7113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783137585.823171:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675353 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729d5 expref: 37 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.823190:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137585.823195:0:7113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137585.823207:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a06 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.823297:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.823310:0:7113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f8 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.823319:0:7113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.823349:0:7113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f8 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.823361:0:7113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f8 expref: 37 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.823373:0:7113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff10000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990141312:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137585.823470:0:7113:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b32840 going to sleep for 11 seconds 00000100:00100000:1.0:1783137585.828825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.828934:0:7113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff10000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990141312:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137585.828971:0:7113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137585.829101:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974409728 00000100:00100000:3.0:1783137585.829114:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974409728 00010000:00010000:3.0:1783137585.829148:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f8 expref: 38 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137585.829191:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:3.0:1783137585.829201:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+38:2351:x1869754974409728:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137585.829215:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137585.829222:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f8 expref: 38 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.829234:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f8 expref: 38 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.829255:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6753d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729f8 expref: 38 pid: 5816 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.829270:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:3.0:1783137585.829275:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.829284:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.829292:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137585.829318:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137585.829367:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:2351:x1869754974409728:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 167us (552us total) trans 0 rc 0/0 00010000:00010000:0.0:1783137585.829368:0:7113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.829375:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137585.829384:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 65 00000004:00200000:0.0:1783137585.829394:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783137585.829533:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6753fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a06 expref: 38 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.829548:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a06 expref: 37 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.829555:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137585.829558:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783137585.829560:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235800, rc 0) 00000100:00100000:0.0:1783137585.829584:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:11415:x1869754974409600:12345-192.168.203.36@tcp:101:dd.0 Request processed in 6478us (6637us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1783137585.829591:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 154 00000100:00100000:1.0:1783137585.832575:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137585.832641:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974409984 00000100:00100000:0.0:1783137585.832650:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974409984 00000100:00100000:0.0:1783137585.832700:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 155 00000100:00100000:0.0:1783137585.832710:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:11415:x1869754974409984:12345-192.168.203.36@tcp:36:dd.0 00010000:00010000:0.0:1783137585.832978:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.833004:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137585.833015:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137585.833084:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1783137585.833111:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe8ecf35 reply state 00000000084d644f transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137585.833120:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137585.833198:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+40:11415:x1869754974409984:12345-192.168.203.36@tcp:36:dd.0 Request processed in 488us (632us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1783137585.833206:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 155 00000020:00080000:0.0:1783137585.833211:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783137585.836069:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.836085:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.836121:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.836127:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137585.836131:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.836139:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.836155:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137585.836158:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137585.836162:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137585.836168:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675410 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137586.112177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.112396:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974410112 00000100:00100000:2.0:1783137586.112407:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974410112 00000100:00100000:2.0:1783137586.112476:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:2.0:1783137586.112488:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+39:11429:x1869754974410112:12345-192.168.203.36@tcp:101:stat.0 00010000:00010000:2.0:1783137586.112510:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137586.112528:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675417 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a0d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.112598:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.112613:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.112640:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.112655:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.112662:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.112669:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783137586.112964:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137586.114272:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.114293:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a06 expref: 40 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.114552:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.115094:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a06 expref: 40 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.115112:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a06 expref: 40 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137586.115127:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990141440:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137586.115225:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137586.122127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.122368:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990141440:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137586.123165:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137586.123306:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974410368 00000100:00100000:0.0:1783137586.123313:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974410368 00000100:00100000:0.0:1783137586.123369:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1783137586.123467:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+41:9953:x1869754974410368:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783137586.124333:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+42:9953:x1869754974410368:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 952us (2212us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1783137586.124342:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:1.0:1783137586.128666:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.129095:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974410496 00000100:00100000:2.0:1783137586.129105:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974410496 00010000:00010000:2.0:1783137586.129143:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a06 expref: 42 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137586.129185:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:2.0:1783137586.129199:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+42:2351:x1869754974410496:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137586.129215:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137586.129222:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a06 expref: 42 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.129235:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a06 expref: 42 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.129257:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675402 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a06 expref: 42 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.129274:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137586.129280:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.129289:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.129295:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.129341:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137586.129410:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+41:2351:x1869754974410496:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 216us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137586.129419:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 66 00010000:00010000:3.0:1783137586.129787:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.129899:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137586.129944:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783137586.129948:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137586.129973:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.129987:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.129997:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130004:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130011:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130017:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137586.130021:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130038:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130064:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:3.0:1783137586.130067:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137586.130071:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130077:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67541e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130089:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130095:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130101:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130105:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137586.130108:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130114:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130121:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970990e98f00) 00010000:00010000:3.0:1783137586.130123:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137586.130126:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130132:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675425 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130193:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac675417 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a0d expref: 41 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130207:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a0d expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.130214:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:3.0:1783137586.130216:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137586.130218:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051400, rc 0) 00000100:00100000:3.0:1783137586.130270:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+40:11429:x1869754974410112:12345-192.168.203.36@tcp:101:stat.0 Request processed in 17786us (18103us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137586.130280:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:1.0:1783137586.211131:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.211456:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974410752 00000100:00100000:0.0:1783137586.211466:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974410752 00000100:00100000:0.0:1783137586.211531:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 157 00000100:00100000:0.0:1783137586.211541:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+40:11435:x1869754974410752:12345-192.168.203.36@tcp:36:truncate.0 00010000:00010000:0.0:1783137586.211606:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137586.211644:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67542c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a0d expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.211665:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137586.211670:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137586.211931:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.211946:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.211957:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137586.212009:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1783137586.212049:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000744edb54 reply state 00000000efd64e94 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137586.212058:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137586.212155:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+42:11435:x1869754974410752:12345-192.168.203.36@tcp:36:truncate.0 Request processed in 614us (1035us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1783137586.212163:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 157 00000020:00080000:0.0:1783137586.212168:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783137586.223169:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.223187:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.223195:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.223201:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137586.223205:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.223212:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.223227:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137586.223230:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137586.223235:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.223240:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675433 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137586.393294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.393375:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974410880 00000100:00100000:0.0:1783137586.393385:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974410880 00000100:00100000:0.0:1783137586.393444:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 158 00000100:00100000:0.0:1783137586.393454:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+41:11448:x1869754974410880:12345-192.168.203.36@tcp:101:stat.0 00010000:00010000:0.0:1783137586.393478:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137586.393498:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac67543a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a14 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.393587:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.393600:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.393611:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.393624:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.393631:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.393637:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394145:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394156:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394163:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137586.394198:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1783137586.394202:0:7113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137586.394221:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394243:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394253:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394259:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394266:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394273:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137586.394277:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394285:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394297:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137586.394301:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137586.394305:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394311:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675441 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394324:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394330:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394341:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394347:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137586.394350:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394356:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394363:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9709860f4b00) 00010000:00010000:0.0:1783137586.394366:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137586.394368:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394374:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675448 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394417:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac67543a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a14 expref: 43 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394431:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a14 expref: 42 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.394437:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137586.394439:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137586.394442:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235200, rc 0) 00000100:00100000:0.0:1783137586.394507:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+42:11448:x1869754974410880:12345-192.168.203.36@tcp:101:stat.0 Request processed in 1053us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137586.394523:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 158 00000100:00100000:0.0:1783137586.486239:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.486284:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137586.486391:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974411136 00000100:00100000:3.0:1783137586.486401:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974411136 00000100:00100000:3.0:1783137586.486466:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 159 00000100:00100000:3.0:1783137586.486477:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+42:11459:x1869754974411136:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137586.486497:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137586.486517:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a1b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137586.486762:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783137586.486977:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675456 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a1b expref: 44 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.486992:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98500) 00010000:00010000:3.0:1783137586.486995:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137586.487009:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a1b expref: 44 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.487033:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005600, rc 0) 00000100:00100000:3.0:1783137586.487091:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+43:11459:x1869754974411136:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 616us (860us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1783137586.487099:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 159 00000100:00100000:0.0:1783137586.487569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.487603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.487628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.487683:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974411648 00000100:00100000:2.0:1783137586.487689:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974411648 00000100:00100000:2.0:1783137586.487740:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:2.0:1783137586.487749:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974411648:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137586.487829:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974411648:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137586.487836:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 146 00000100:00100000:2.0:1783137586.487865:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974411264 00000100:00100000:2.0:1783137586.487869:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974411264 00000100:00100000:2.0:1783137586.487893:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 292 00000100:00100000:2.0:1783137586.487899:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97098736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974411264:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137586.487937:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97098736b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974411264:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137586.487944:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 292 00000100:00080000:3.0:1783137586.488273:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137586.493777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.494665:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974411904 00000100:00100000:0.0:1783137586.494675:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974411904 00000100:00100000:0.0:1783137586.494743:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:0.0:1783137586.494763:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+43:11459:x1869754974411904:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137586.495467:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+44:11459:x1869754974411904:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 712us (1696us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1783137586.495476:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:1.0:1783137586.497506:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974411392 00000100:00100000:1.0:1783137586.497521:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974411392 00000100:00080000:0.0:1783137586.497670:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137586.498413:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974411520 00000100:00100000:1.0:1783137586.498420:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974411520 00000100:00080000:3.0:1783137586.505544:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783137586.505765:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:2.0:1783137586.505786:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974411392:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137586.505879:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974411392:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 103us (19594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137586.505887:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:2.0:1783137586.505910:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:2.0:1783137586.505917:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974411520:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137586.505941:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974411520:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (18313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137586.505947:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:3.0:1783137586.559692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.559775:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974412160 00000100:00100000:2.0:1783137586.559786:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974412160 00000100:00100000:2.0:1783137586.559883:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:2.0:1783137586.559893:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+44:11465:x1869754974412160:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1783137586.559918:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137586.559937:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675464 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a22 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.560051:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.560065:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a14 expref: 45 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.560073:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.560109:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a14 expref: 45 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.560122:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a14 expref: 45 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137586.560136:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990141568:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137586.560239:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1783137586.563462:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd26f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990141568:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137586.563487:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137586.565179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.565275:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974412288 00000100:00100000:0.0:1783137586.565283:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974412288 00010000:00010000:0.0:1783137586.565319:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a14 expref: 46 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137586.565355:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:0.0:1783137586.565364:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf237480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+46:2351:x1869754974412288:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137586.565378:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137586.565384:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a14 expref: 46 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.565396:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a14 expref: 46 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.565428:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac67544f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a14 expref: 46 pid: 7113 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.565442:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137586.565447:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.565456:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.565463:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.565495:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137586.565549:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf237480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+45:2351:x1869754974412288:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 185us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137586.565557:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 67 00010000:00010000:2.0:1783137586.565756:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.565765:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137586.565831:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783137586.565972:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675464 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a22 expref: 46 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.565987:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a22 expref: 45 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.565994:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137586.565996:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783137586.565999:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050600, rc 0) 00000100:00100000:2.0:1783137586.566039:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+45:11465:x1869754974412160:12345-192.168.203.36@tcp:101:bash.0 Request processed in 6148us (6357us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1783137586.566047:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:3.0:1783137586.571094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.571460:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974412544 00000100:00100000:2.0:1783137586.571470:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974412544 00000100:00100000:2.0:1783137586.571585:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:2.0:1783137586.571595:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+45:11465:x1869754974412544:12345-192.168.203.36@tcp:36:bash.0 00010000:00010000:2.0:1783137586.571876:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.571902:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.571914:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137586.571966:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:2.0:1783137586.572007:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c3b24a7 reply state 00000000dfe57a25 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137586.572017:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137586.572266:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:11465:x1869754974412544:12345-192.168.203.36@tcp:36:bash.0 Request processed in 671us (1177us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1783137586.572274:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 161 00000020:00080000:2.0:1783137586.572279:0:7113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783137586.573272:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.573285:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.573291:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.573298:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137586.573303:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.573310:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.573324:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137586.573327:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137586.573332:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.573338:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675479 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137586.581189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.581306:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974412672 00000100:00100000:0.0:1783137586.581316:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974412672 00000100:00100000:0.0:1783137586.581374:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:0.0:1783137586.581384:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:11465:x1869754974412672:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137586.581415:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137586.581435:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675480 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a29 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.582146:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.582179:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a22 expref: 48 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.582189:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.582223:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a22 expref: 48 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.582237:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a22 expref: 48 pid: 5814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137586.582251:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff10380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990141696:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137586.582414:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b32840 going to sleep for 11 seconds 00000100:00100000:2.0:1783137586.585411:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff10380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990141696:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137586.585450:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137586.585653:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.587465:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974412800 00000100:00100000:2.0:1783137586.587476:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974412800 00010000:00010000:2.0:1783137586.587518:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a22 expref: 49 pid: 5814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137586.587559:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:2.0:1783137586.587568:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+49:2352:x1869754974412800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137586.587584:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137586.587591:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a22 expref: 49 pid: 5814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.587604:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a22 expref: 49 pid: 5814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.587625:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac67546b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a22 expref: 49 pid: 5814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.587641:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137586.587646:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.587724:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.587731:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.587859:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137586.587924:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:2352:x1869754974412800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 356us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137586.587933:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 68 00010000:00010000:0.0:1783137586.589754:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.589769:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137586.590143:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783137586.590149:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137586.590172:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.590208:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675480 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a29 expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.590226:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a29 expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.590249:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137586.590252:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137586.590255:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234000, rc 0) 00000100:00100000:0.0:1783137586.590358:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:11465:x1869754974412672:12345-192.168.203.36@tcp:101:bash.0 Request processed in 8974us (9177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137586.590367:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 162 00000100:00100000:1.0:1783137586.604371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.604480:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974413056 00000100:00100000:0.0:1783137586.604489:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974413056 00000100:00100000:0.0:1783137586.604642:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:0.0:1783137586.604662:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:11465:x1869754974413056:12345-192.168.203.36@tcp:35:bash.0 00000100:00100000:0.0:1783137586.604995:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:11465:x1869754974413056:12345-192.168.203.36@tcp:35:bash.0 Request processed in 343us (631us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1783137586.605311:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 45 00010000:00010000:2.0:1783137586.663554:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137586.675058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137586.675252:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974413312 00000100:00100000:3.0:1783137586.675261:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974413312 00000100:00100000:3.0:1783137586.675326:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 163 00000100:00100000:3.0:1783137586.675335:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:11475:x1869754974413312:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137586.675358:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137586.675377:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67548e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137586.675625:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783137586.675930:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67548e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a30 expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.675955:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98500) 00010000:00010000:3.0:1783137586.675958:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137586.675963:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67548e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a30 expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137586.675975:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005600, rc 0) 00000100:00100000:3.0:1783137586.676041:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+49:11475:x1869754974413312:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 707us (992us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1783137586.676050:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 163 00000100:00100000:1.0:1783137586.679456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.679547:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974413440 00000100:00100000:2.0:1783137586.679556:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974413440 00000100:00100000:2.0:1783137586.679610:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 164 00000100:00100000:2.0:1783137586.679621:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+49:11475:x1869754974413440:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:2.0:1783137586.679686:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.679701:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.679712:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.679725:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.679732:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.679738:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680067:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680084:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680091:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137586.680132:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680144:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680151:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680158:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680163:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137586.680167:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680174:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680186:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:2.0:1783137586.680189:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137586.680194:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680199:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67549c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680217:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680223:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680228:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680232:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137586.680234:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680239:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680247:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970990e98900) 00010000:00010000:2.0:1783137586.680249:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137586.680252:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680257:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680270:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680276:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680281:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680292:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137586.680295:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680301:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680310:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137586.680312:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137586.680315:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.680320:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137586.680605:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+49:11475:x1869754974413440:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 984us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137586.680614:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 164 00000100:00100000:1.0:1783137586.691080:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137586.691933:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974413696 00000100:00100000:3.0:1783137586.691945:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974413696 00000100:00100000:3.0:1783137586.692140:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:3.0:1783137586.692152:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+49:11475:x1869754974413696:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1783137586.693200:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:11475:x1869754974413696:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 1044us (2427us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1783137586.693211:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:3.0:1783137586.756093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.756321:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974413952 00000100:00100000:2.0:1783137586.756331:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974413952 00000100:00100000:2.0:1783137586.756392:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:2.0:1783137586.756402:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:11478:x1869754974413952:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137586.756425:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137586.756455:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a37 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.756524:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.756555:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.756586:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.756603:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.756610:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.756616:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758061:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6754c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758076:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6754c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758086:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6754c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137586.758098:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783137586.758193:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758201:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758209:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758224:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137586.758228:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758236:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758487:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:2.0:1783137586.758492:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137586.758496:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758503:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac6754b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758518:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758524:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758529:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758533:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137586.758536:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758541:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758561:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970990e98900) 00010000:00010000:2.0:1783137586.758563:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137586.758727:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.758735:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6754bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.759128:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a37 expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.759143:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6754c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a37 expref: 52 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.759151:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:2.0:1783137586.759153:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137586.759156:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050200, rc 0) 00000100:00100000:2.0:1783137586.759228:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:11478:x1869754974413952:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2827us (3143us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1783137586.759237:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:1.0:1783137586.763606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137586.763708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.763929:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974414080 00000100:00100000:0.0:1783137586.763939:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974414080 00000100:00100000:0.0:1783137586.763992:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:0.0:1783137586.764001:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:11478:x1869754974414080:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:0.0:1783137586.764070:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.764086:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.764096:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.764148:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.764155:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.764162:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.764167:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137586.764171:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.764178:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.764188:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137586.764191:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137586.764195:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.764200:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137586.764268:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:11478:x1869754974414080:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 267us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137586.764275:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:3.0:1783137586.772947:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974414208 00000100:00100000:3.0:1783137586.772961:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974414208 00000100:00100000:1.0:1783137586.773426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.773492:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974414464 00000100:00100000:0.0:1783137586.773497:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974414464 00000100:00100000:0.0:1783137586.773538:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:0.0:1783137586.773562:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:11478:x1869754974414464:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137586.773774:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11478:x1869754974414464:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 214us (351us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1783137586.773811:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:0.0:1783137586.774194:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:0.0:1783137586.774202:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:2352:x1869754974414208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137586.774213:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137586.774245:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac6754c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a37 expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.774263:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137586.774267:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137586.774295:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:2352:x1869754974414208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 95us (10588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137586.774301:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:1.0:1783137586.885159:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.885273:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974414720 00000100:00100000:0.0:1783137586.885283:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974414720 00000100:00100000:0.0:1783137586.885341:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:0.0:1783137586.885351:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:11496:x1869754974414720:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1783137586.885372:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137586.885391:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a3e expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.885483:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6754e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.885513:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6754e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.885524:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6754e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137586.885536:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783137586.885652:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a3e expref: 55 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.885671:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6754e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a3e expref: 54 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.885679:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137586.885682:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783137586.885685:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235e00, rc 0) 00000100:00100000:0.0:1783137586.885744:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11496:x1869754974414720:12345-192.168.203.36@tcp:101:cat.0 Request processed in 394us (594us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1783137586.886667:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 167 00000100:00100000:1.0:1783137586.922942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.923124:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974414848 00000100:00100000:0.0:1783137586.923134:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974414848 00000100:00100000:0.0:1783137586.923195:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 168 00000100:00100000:0.0:1783137586.923204:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11497:x1869754974414848:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137586.923227:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137586.923254:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a45 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.923330:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6754f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.923344:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6754f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.923356:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6754f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137586.923531:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1783137586.923535:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137586.923614:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6754f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.923639:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6754f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a45 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.923655:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6754f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a45 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.923664:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137586.923667:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137586.923671:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234600, rc 0) 00000100:00100000:0.0:1783137586.923764:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11497:x1869754974414848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 561us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137586.923772:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 168 00000100:00100000:1.0:1783137586.931640:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.931845:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974415232 00000100:00100000:0.0:1783137586.931854:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974415232 00000100:00100000:0.0:1783137586.931956:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:0.0:1783137586.931966:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11497:x1869754974415232:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137586.932393:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:11497:x1869754974415232:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 427us (902us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1783137586.932402:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:1.0:1783137586.937432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.937524:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974415360 00000100:00100000:0.0:1783137586.937533:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974415360 00000100:00100000:0.0:1783137586.937595:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:0.0:1783137586.937605:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:11497:x1869754974415360:12345-192.168.203.36@tcp:103:lfs.0 00010000:00010000:0.0:1783137586.937620:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783137586.937643:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac675487 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a29 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.937665:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac6754e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a3e expref: 55 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.937679:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac675392 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ea expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.937690:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98b00) 00010000:00010000:0.0:1783137586.937700:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137586.938215:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:11497:x1869754974415360:12345-192.168.203.36@tcp:103:lfs.0 Request processed in 600us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137586.938224:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1783137586.943192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137586.947357:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974415488 00000100:00100000:2.0:1783137586.947371:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974415488 00000100:00100000:2.0:1783137586.947502:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 169 00000100:00100000:2.0:1783137586.947514:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:11497:x1869754974415488:12345-192.168.203.36@tcp:58:lfs.0 00010000:00010000:2.0:1783137586.947617:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.947635:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137586.947661:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783137586.947891:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1783137586.947989:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:11497:x1869754974415488:12345-192.168.203.36@tcp:58:lfs.0 Request processed in 470us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137586.947998:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 169 00000100:00100000:1.0:1783137586.965870:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137586.965956:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974415616 00000100:00100000:0.0:1783137586.965967:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974415616 00000100:00100000:0.0:1783137586.966037:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 170 00000100:00100000:0.0:1783137586.966063:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+53:11499:x1869754974415616:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137586.966097:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137586.966117:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675505 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a4c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966194:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966208:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966219:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966233:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966239:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966367:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966840:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966850:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966858:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137586.966904:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783137586.966909:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137586.966928:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966939:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966947:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966953:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966959:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966965:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137586.966969:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966975:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.966987:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137586.966990:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137586.966995:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967002:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac67550c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967041:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967048:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967054:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967060:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137586.967063:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967069:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967088:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9709860f4b00) 00010000:00010000:0.0:1783137586.967091:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137586.967095:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967100:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675513 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967130:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675505 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a4c expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967143:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a4c expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137586.967162:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98900) 00010000:00010000:0.0:1783137586.967165:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137586.967168:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235c00, rc 0) 00000100:00100000:0.0:1783137586.967236:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11499:x1869754974415616:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1176us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137586.967636:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 170 00000040:00080000:3.0:1783137587.367983:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137587.368005:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137587.368053:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:3.0:1783137587.368061:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137587.368171:0:11579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7955f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990141824:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783137587.368282:0:11579:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b0bbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137587.371570:0:11579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7955f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990141824:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783137587.373655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137587.374105:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974415744 00000100:00100000:0.0:1783137587.374116:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974415744 00000100:00100000:0.0:1783137587.374173:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:0.0:1783137587.374183:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11510:x1869754974415744:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783137587.374214:0:7113:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783137587.374320:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11510:x1869754974415744:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 138us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137587.374328:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 171 00000100:00100000:1.0:1783137587.377113:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137587.377188:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974415872 00000100:00100000:2.0:1783137587.377196:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974415872 00000100:00100000:2.0:1783137587.377250:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:2.0:1783137587.377260:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11510:x1869754974415872:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783137587.377327:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377342:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377355:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377370:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377377:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377383:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377406:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377420:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377427:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137587.377477:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783137587.377481:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137587.377494:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377505:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377511:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377518:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377524:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137587.377527:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377534:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377545:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:2.0:1783137587.377549:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137587.377553:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377569:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac675521 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377582:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377588:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377594:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377599:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137587.377602:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377608:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377616:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff970990e98800) 00010000:00010000:2.0:1783137587.377619:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137587.377621:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377626:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675528 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377639:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377645:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377656:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377661:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137587.377664:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377669:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377676:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98900) 00010000:00010000:2.0:1783137587.377679:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137587.377681:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.377687:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67552f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137587.377749:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11510:x1869754974415872:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 Request processed in 490us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137587.377756:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 172 00000100:00100000:2.0:1783137587.382685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.382760:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974416128 00000100:00100000:3.0:1783137587.382769:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974416128 00000100:00100000:3.0:1783137587.382851:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 173 00000100:00100000:3.0:1783137587.382862:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11510:x1869754974416128:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137587.382881:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137587.382899:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac675536 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a53 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.382989:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383003:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383028:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137587.383040:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783137587.383129:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383137:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383142:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383147:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137587.383159:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383166:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383178:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98900) 00010000:00010000:3.0:1783137587.383181:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137587.383184:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383190:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac67553d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383229:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac675536 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a53 expref: 56 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383239:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:3.0:1783137587.383241:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783137587.383245:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac675536 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a53 expref: 56 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.383254:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005a00, rc 0) 00000100:00100000:3.0:1783137587.383308:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11510:x1869754974416128:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 448us (630us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1783137587.383317:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 173 00000100:00100000:3.0:1783137587.387132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137587.387201:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974416256 00000100:00100000:2.0:1783137587.387210:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974416256 00000100:00100000:2.0:1783137587.387262:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 174 00000100:00100000:2.0:1783137587.387272:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11510:x1869754974416256:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783137587.387306:0:5814:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783137587.387403:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11510:x1869754974416256:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137587.387418:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 174 00000100:00100000:1.0:1783137587.391768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.392136:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974416512 00000100:00100000:3.0:1783137587.392146:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974416512 00000100:00100000:3.0:1783137587.392203:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 175 00000100:00100000:3.0:1783137587.392222:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11510:x1869754974416512:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137587.392242:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137587.392246:0:7113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783137587.392271:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6754f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a45 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.392286:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:3.0:1783137587.392290:0:7113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137587.392302:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67554b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a5a expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783137587.392919:0:7113:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1783137587.393119:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675552 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.393133:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.393144:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.393195:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67554b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a5a expref: 57 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.393210:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a5a expref: 56 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.393217:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970987960b00) 00010000:00010000:3.0:1783137587.393220:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137587.393230:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005600, rc 0) 00000100:00100000:3.0:1783137587.393287:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:11510:x1869754974416512:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 1066us (1525us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1783137587.393295:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 175 00000100:00100000:0.0:1783137587.405919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137587.408377:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974416768 00000100:00100000:2.0:1783137587.408393:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974416768 00000100:00100000:2.0:1783137587.408547:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:2.0:1783137587.408558:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:11510:x1869754974416768:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783137587.408614:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137587.408641:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005600/0x88def104ac675552 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a5a expref: 56 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.408658:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970987960b00) 00010000:00010000:2.0:1783137587.408669:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137587.408690:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.408702:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.408711:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.408782:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.408809:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.409929:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410203:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410211:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410217:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410223:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137587.410300:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410309:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410320:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:2.0:1783137587.410322:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137587.410326:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410332:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675560 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410343:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410348:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410353:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410364:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137587.410367:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410372:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410379:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc05b9062 (ffff970990e98c00) 00010000:00010000:2.0:1783137587.410381:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137587.410383:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.410388:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675567 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc05b9062 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137587.410480:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11510:x1869754974416768:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 1921us (4566us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783137587.410489:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 176 00000100:00100000:1.0:1783137587.414459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137587.414497:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974416896 00000100:00100000:1.0:1783137587.414506:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974416896 00000100:00100000:1.0:1783137587.414554:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:1.0:1783137587.414563:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11510:x1869754974416896:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137587.414583:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137587.414605:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67556e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a61 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.414639:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.414651:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.414660:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.414758:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67556e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a61 expref: 57 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.414777:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a61 expref: 56 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.414786:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:1.0:1783137587.414789:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783137587.414821:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c200, rc 0) 00000100:00100000:1.0:1783137587.414870:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:11510:x1869754974416896:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 307us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137587.414882:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 177 00000100:00100000:3.0:1783137587.421390:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.421486:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974417152 00000100:00100000:3.0:1783137587.421496:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974417152 00000100:00100000:3.0:1783137587.421543:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 178 00000100:00100000:3.0:1783137587.421551:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:11510:x1869754974417152:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783137587.421623:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.421639:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.421650:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137587.423165:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1783137587.423178:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343320385156ns, next at 344320382688ns, rc = 0 00000004:00010000:3.0:1783137587.423985:0:5814:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003504ef19 reply state 000000002e4d610d transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137587.423998:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137587.424155:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:11510:x1869754974417152:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 2600us (2771us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1783137587.424165:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 178 00000100:00100000:1.0:1783137587.428400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.428474:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974417280 00000100:00100000:3.0:1783137587.428484:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974417280 00000100:00100000:3.0:1783137587.428541:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 179 00000100:00100000:3.0:1783137587.428551:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:11510:x1869754974417280:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137587.428573:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137587.428593:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a68 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.428650:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a68 expref: 59 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.428665:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a68 expref: 59 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.428685:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:3.0:1783137587.428688:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783137587.428691:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004400, rc 0) 00000100:00100000:3.0:1783137587.428741:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11510:x1869754974417280:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 192us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137587.428754:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 179 00010000:00010000:0.0:1783137587.433382:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.433400:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.433408:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.433414:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137587.433419:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.433442:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.433460:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:0.0:1783137587.433463:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783137587.433468:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.433474:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac67557c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137587.449405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137587.449632:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974417408 00000100:00100000:0.0:1783137587.449642:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974417408 00000100:00100000:0.0:1783137587.449699:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:0.0:1783137587.449709:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709897ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974417408:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783137587.450986:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709897ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2351:x1869754974417408:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 1274us (1587us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1783137587.450997:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:0.0:1783137587.457223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137587.457358:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974417664 00000100:00100000:1.0:1783137587.457368:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974417664 00000100:00100000:1.0:1783137587.457425:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:1.0:1783137587.457435:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:11510:x1869754974417664:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783137587.457657:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11510:x1869754974417664:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 223us (440us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1783137587.457665:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:0.0:1783137587.462217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.462438:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974417920 00000100:00100000:3.0:1783137587.462448:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974417920 00000100:00100000:3.0:1783137587.462504:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 180 00000100:00100000:3.0:1783137587.462515:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11510:x1869754974417920:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783137587.462612:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11510:x1869754974417920:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 99us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137587.462619:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 180 00000100:00100000:3.0:1783137587.465136:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137587.465213:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974418048 00000100:00100000:0.0:1783137587.465222:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974418048 00000100:00100000:0.0:1783137587.465296:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:0.0:1783137587.465305:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11510:x1869754974418048:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137587.465324:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137587.465344:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67558a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a6f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.465428:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675591 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.465441:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.465450:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137587.465483:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137587.465501:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.465525:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67558a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a6f expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.465541:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a6f expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.465548:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:0.0:1783137587.465551:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783137587.465554:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234a00, rc 0) 00000100:00100000:0.0:1783137587.471763:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11510:x1869754974418048:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 6441us (6619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137587.471775:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 181 00000100:00100000:0.0:1783137587.482436:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137587.482924:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974418176 00000100:00100000:0.0:1783137587.482933:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974418176 00000100:00100000:0.0:1783137587.482998:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:0.0:1783137587.483008:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974418176:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137587.483033:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137587.483052:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a76 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783137587.483079:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a488533, blocks: 0x1 00010000:00010000:0.0:1783137587.483097:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1783137587.483102:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137587.483111:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a76 expref: 8 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.483129:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a76 expref: 8 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.483141:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235000, rc 0) 00000100:00100000:0.0:1783137587.483196:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974418176:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 189us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137587.483203:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:0.0:1783137587.486352:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.486476:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974418432 00000100:00100000:3.0:1783137587.486485:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974418432 00000100:00100000:3.0:1783137587.486538:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:3.0:1783137587.486548:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11510:x1869754974418432:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783137587.486656:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11510:x1869754974418432:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 108us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137587.486664:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 182 00000100:00100000:1.0:1783137587.496621:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.496709:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974418560 00000100:00100000:3.0:1783137587.496718:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974418560 00000100:00100000:3.0:1783137587.496783:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:3.0:1783137587.496959:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:11510:x1869754974418560:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137587.496977:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137587.496996:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a7d expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.497035:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a76 expref: 9 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.497046:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137587.497049:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137587.497054:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 9 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.497087:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a76 expref: 9 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.497114:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a76 expref: 9 pid: 6618 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137587.497129:0:6619:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970988ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990141952:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137587.497213:0:6619:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783137587.501822:0:6619:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970988ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990141952:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137587.501857:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 9 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.501878:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005200, rc 0) 00000100:00100000:3.0:1783137587.501934:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:11510:x1869754974418560:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 5142us (5321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137587.501943:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:3.0:1783137587.513219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137587.513370:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974418688 00000100:00100000:0.0:1783137587.513380:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974418688 00010000:00010000:0.0:1783137587.513418:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a76 expref: 9 pid: 6618 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137587.513462:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:0.0:1783137587.513480:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2351:x1869754974418688:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137587.513494:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137587.513514:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a76 expref: 9 pid: 6618 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.513526:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a76 expref: 9 pid: 6618 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.513548:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675598 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a76 expref: 9 pid: 6618 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.513562:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137587.513566:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137587.513574:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.513583:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.513617:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137587.513630:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b18d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5801:1869754990142080:192.168.203.36@tcp:105: 00000100:00100000:0.0:1783137587.513700:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b320c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137587.523572:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b18d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5801:1869754990142080:192.168.203.36@tcp:105: 00010000:00010000:3.0:1783137587.523598:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137587.523655:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974418688:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10176us (10445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137587.523665:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:3.0:1783137587.527739:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137587.528095:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974418816 00000100:00100000:1.0:1783137587.528104:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974418816 00002000:00100000:1.0:1783137587.528152:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff970985322a00 x1869754974418816/t0(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:493/0 lens 504/0 e 0 to 0 dl 1783137598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783137587.528161:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff970985322a00 with x1869754974418816 ext(0->8) 00002000:00010000:1.0:1783137587.528166:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff970985322a00 00000100:00100000:1.0:1783137587.528357:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:1.0:1783137587.528372:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974418816:12345-192.168.203.36@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783137587.529193:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:2352:x1869754974418816:12345-192.168.203.36@tcp:4:lhsmtool_posix.0 Request processed in 820us (1458us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783137587.529204:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00002000:00100000:1.0:1783137587.529212:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff970985322a00 x1869754974418816/t4294967314(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:493/0 lens 504/448 e 0 to 0 dl 1783137598 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783137587.529247:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff970985322a00 with x1869754974418816 ext(0->8) 00002000:00010000:1.0:1783137587.529252:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff970985322a00 00000100:00100000:0.0:1783137587.532072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.532151:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974418944 00000100:00100000:3.0:1783137587.532160:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974418944 00000100:00100000:3.0:1783137587.532216:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 183 00000100:00100000:3.0:1783137587.532334:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11510:x1869754974418944:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783137587.562659:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:0.0:1783137587.562720:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1783137587.562750:0:5836:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97098f15a000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1783137587.562755:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff970985484000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97098f15a480 00000020:00080000:0.0:1783137587.562758:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff970985484500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff970985350800 00000001:00080000:0.0:1783137587.562780:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:0.0:1783137587.562836:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:3.0:1783137587.563150:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:11510:x1869754974418944:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 Request processed in 30920us (31081us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137587.563161:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 183 00000020:00080000:1.0:1783137587.566294:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1783137587.566463:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1783137587.566526:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990142336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783137587.566595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137587.566634:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137587.566641:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990142208:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783137587.566663:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137587.566694:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990142336 00000100:00100000:1.0:1783137587.566700:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990142336 00000100:00100000:1.0:1783137587.566742:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990142208 00000100:00100000:1.0:1783137587.567185:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990142208 00000100:00100000:1.0:1783137587.567217:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783137587.567226:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990142336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783137587.567364:0:6618:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783137587.567368:0:6618:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783137587 00002000:00010000:1.0:1783137587.567370:0:6618:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783137587.567372:0:6618:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783137587 -> 1783137587 00002000:00010000:1.0:1783137587.567375:0:6618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783137587.567417:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990142336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (820us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1783137587.567423:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783137587.567439:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783137587.567445:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990142208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783137587.567473:0:6618:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1783137587.567497:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a488530, atime: 0x6a488530, ctime: 0x6a488530, blocks: 0xb 00010000:00010000:1.0:1783137587.567505:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.567521:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1783137587.567525:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137587.567530:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.567545:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.567554:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.567561:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.567575:0:6618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137587.568401:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137587.568410:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.568421:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137587.568424:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.568433:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.568449:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.568456:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cba6e535/0x88def104ac6755a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.568476:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137587.568478:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137587.568479:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137587.569738:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990142208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2287us (3068us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783137587.569760:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783137587.571583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.571611:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974419072 00000100:00100000:3.0:1783137587.571621:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974419072 00000100:00100000:3.0:1783137587.571667:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:3.0:1783137587.571689:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:2351:x1869754974419072:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1783137587.572069:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137587.572074:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137587.572115:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1783137587.572121:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1783137587.572153:0:3309:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9709bc835180 x1869754990142208/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783137603 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783137587.572166:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709bc835180/2, rc 0, transno 4294967307 00000100:00100000:1.0:1783137587.572172:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990142208:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783137587.572191:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709bc835c00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1783137587.572195:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990142336:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1783137587.690616:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137587.712033:0:12351:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137587.712042:0:12351:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137587.712085:0:12351:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:0.0:1783137587.712092:0:12351:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137587.722576:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970985322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:2351:x1869754974419072:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 Request processed in 150880us (150992us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137587.722589:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 55 00000001:00080000:3.0:1783137587.722620:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1783137587.722630:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1783137587.722635:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1783137587.725408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.725617:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974419328 00000100:00100000:3.0:1783137587.725627:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974419328 00000100:00100000:3.0:1783137587.725686:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 184 00000100:00100000:3.0:1783137587.725696:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:11510:x1869754974419328:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783137587.725758:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137587.725785:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675591 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a6f expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.725943:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:3.0:1783137587.725948:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137587.725978:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.725991:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.726001:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137587.726260:0:5814:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e4dddf9 reply state 00000000f8e56b23 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137587.726288:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137587.726385:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:11510:x1869754974419328:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 689us (985us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1783137587.726392:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 184 00010000:00010000:3.0:1783137587.729916:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.729931:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.729938:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.729944:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137587.729948:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.729956:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.729971:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:3.0:1783137587.729974:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137587.729978:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.729984:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137587.730504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137587.733635:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974419456 00000100:00100000:1.0:1783137587.733648:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974419456 00000100:00100000:1.0:1783137587.733961:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:1.0:1783137587.733973:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974419456:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783137587.734210:0:6618:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783137587.734213:0:6618:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783137587 -> 1783137586 00002000:00010000:1.0:1783137587.734216:0:6618:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783137584 00002000:00010000:1.0:1783137587.734218:0:6618:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783137587 -> 1783137586 00002000:00010000:1.0:1783137587.734221:0:6618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783137587.734282:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974419456:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 312us (3782us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1783137587.734290:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:1.0:1783137587.747272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137587.747613:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974419712 00000100:00100000:0.0:1783137587.747622:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974419712 00000100:00100000:0.0:1783137587.747680:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 185 00000100:00100000:0.0:1783137587.747690:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:11510:x1869754974419712:12345-192.168.203.36@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783137587.747753:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.747770:0:7113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a61 expref: 18 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.747781:0:7113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.747851:0:7113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a61 expref: 18 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.747864:0:7113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a61 expref: 18 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137587.747887:0:7113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990142464:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137587.747963:0:7113:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098f15aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137587.751846:0:7113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990142464:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137587.751873:0:7113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137587.757252:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137587.757330:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974419840 00000100:00100000:2.0:1783137587.757340:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974419840 00010000:00010000:2.0:1783137587.757379:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a61 expref: 19 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137587.757420:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:2.0:1783137587.757430:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:2352:x1869754974419840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137587.757443:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137587.757450:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a61 expref: 19 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.757483:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a61 expref: 19 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.757506:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a61 expref: 19 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.757520:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:2.0:1783137587.757526:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.757536:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.757543:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.757570:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137587.757617:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:2352:x1869754974419840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 188us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137587.757624:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 70 00010000:00010000:3.0:1783137587.758008:0:7113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.758032:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.758060:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.758067:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.758073:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.758079:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137587.758083:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.758091:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.758114:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:3.0:1783137587.758118:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783137587.758122:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.758173:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6755b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137587.758226:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:11510:x1869754974419712:12345-192.168.203.36@tcp:55:lhsmtool_posix.0 Request processed in 10537us (10963us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783137587.758235:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 185 00000100:00100000:1.0:1783137587.767975:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137587.768009:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974419968 00000100:00100000:1.0:1783137587.768033:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974419968 00000100:00100000:1.0:1783137587.768078:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:1.0:1783137587.768085:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974419968:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783137587.768136:0:8200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.768154:0:8200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.768163:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137587.768167:0:8200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783137587.768172:0:8200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.768203:0:8200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.768216:0:8200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 8 pid: 6619 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137587.768230:0:8200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc834a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8200:1869754990142592:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137587.768301:0:8200:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098ddf1000 going to sleep for 11 seconds 00000100:00100000:0.0:1783137587.775775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137587.776142:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974420096 00000100:00100000:0.0:1783137587.776151:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974420096 00010000:00010000:0.0:1783137587.776188:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 9 pid: 6619 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137587.776223:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:0.0:1783137587.776234:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2352:x1869754974420096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137587.776248:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137587.776267:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 9 pid: 6619 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.776281:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 9 pid: 6619 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.776305:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137587.776309:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137587.776314:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.776324:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.776354:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137587.776399:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2352:x1869754974420096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 168us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137587.776407:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 71 00010000:00010000:0.0:1783137587.777314:0:8200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c9e5e1f/0x88def104ac67559f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a7d expref: 8 pid: 6619 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137587.777332:0:8200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc834a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8200:1869754990142592:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137587.777351:0:8200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.777362:0:8200:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.777369:0:8200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.777396:0:8200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.777405:0:8200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.777414:0:8200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.777432:0:8200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137587.777436:0:8200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.777445:0:8200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.777460:0:8200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137587.777468:0:8200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd6acb21/0x88def104ac6755bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137587.777536:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974419968:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 Request processed in 9449us (9569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137587.777545:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:0.0:1783137587.780529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.780594:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974420352 00000100:00100000:3.0:1783137587.780604:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974420352 00000100:00100000:3.0:1783137587.780662:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 186 00000100:00100000:3.0:1783137587.780672:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+17:11510:x1869754974420352:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783137587.780740:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.780756:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.780767:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.780980:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.780992:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a68 expref: 18 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.781000:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.781040:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a68 expref: 18 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.781054:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a68 expref: 18 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137587.781068:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990142720:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137587.781135:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b32840 going to sleep for 11 seconds 00000100:00100000:1.0:1783137587.783359:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990142720:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137587.783385:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137587.786519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137587.790061:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974420480 00000100:00100000:2.0:1783137587.790074:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974420480 00010000:00010000:2.0:1783137587.790115:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a68 expref: 19 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137587.791076:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:2.0:1783137587.791090:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:2351:x1869754974420480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137587.791116:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137587.791125:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a68 expref: 19 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.791140:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a68 expref: 19 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.791160:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac675583 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a68 expref: 19 pid: 7113 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.791173:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:2.0:1783137587.791178:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.791187:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.791195:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.791225:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137587.791280:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:2351:x1869754974420480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 193us (4769us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137587.791289:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 72 00010000:00010000:1.0:1783137587.791340:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.791352:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783137587.791509:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1783137587.791641:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1783137587.791682:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1783137587.791754:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc834700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5814:1869754990142848:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783137587.791992:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137587.792037:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7480 going to sleep for 11 seconds 00000100:00100000:3.0:1783137587.792080:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990142848 00000100:00100000:3.0:1783137587.792086:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990142848 00000100:00100000:3.0:1783137587.792127:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783137587.792134:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1869754990142848:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783137587.792198:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1869754990142848:12345-0@lo:1000:mdt00_000.0 Request processed in 64us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137587.792205:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783137587.792271:0:5814:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1783137587.792277:0:5814:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709bc835c00, transno 4294967315 00000100:00100000:1.0:1783137587.792295:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc834700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5814:1869754990142848:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1783137587.792717:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1783137587.792771:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc834700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5814:1869754990142976:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783137587.793173:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137587.793230:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137587.794329:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990142976 00000100:00100000:3.0:1783137587.794338:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990142976 00000100:00100000:3.0:1783137587.794383:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783137587.794392:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1869754990142976:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783137587.794644:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5814:x1869754990142976:12345-0@lo:1000:mdt00_000.0 Request processed in 252us (1470us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1783137587.794652:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783137587.797163:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc834700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5814:1869754990142976:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783137587.798325:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798339:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798346:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798352:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137587.798357:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798376:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798391:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970990e51e00) 00010000:00010000:1.0:1783137587.798394:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137587.798398:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798403:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6755c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798432:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798438:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798443:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798448:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137587.798451:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798456:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798464:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98900) 00010000:00010000:1.0:1783137587.798466:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137587.798468:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798483:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6754fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798504:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798519:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a4c expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798528:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798560:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a4c expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137587.798575:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a4c expref: 21 pid: 5816 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137587.798589:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc834380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990143104:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137587.798698:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7300 going to sleep for 11 seconds 00000100:00100000:0.0:1783137587.803679:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137587.803777:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc834380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990143104:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137587.803826:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137587.804177:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974420608 00000100:00100000:3.0:1783137587.804184:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974420608 00010000:00010000:3.0:1783137587.804219:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a4c expref: 22 pid: 5816 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137587.804250:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:3.0:1783137587.804258:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+22:2352:x1869754974420608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137587.804271:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137587.804278:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a4c expref: 22 pid: 5816 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.804288:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a4c expref: 22 pid: 5816 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.804327:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac67551a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a4c expref: 22 pid: 5816 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.804340:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98900) 00010000:00010000:3.0:1783137587.804345:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.804353:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.804361:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.804389:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137587.804432:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:2352:x1869754974420608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 175us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137587.804440:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 73 00010000:00010000:2.0:1783137587.804493:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804501:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804520:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804526:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804532:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804537:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137587.804541:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804547:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804556:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98900) 00010000:00010000:2.0:1783137587.804558:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137587.804561:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804567:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804577:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804582:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804587:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804597:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137587.804600:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804606:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804613:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e98900) 00010000:00010000:2.0:1783137587.804615:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783137587.804618:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.804623:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6755c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137587.804978:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:11510:x1869754974420352:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 24307us (24456us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1783137587.804988:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 186 00000020:00080000:2.0:1783137587.804992:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783137587.805233:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137587.805238:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137587.805725:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1783137587.805735:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783137587.808218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137587.808291:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974420864 00000100:00100000:3.0:1783137587.808299:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974420864 00000100:00100000:3.0:1783137587.808352:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:3.0:1783137587.808362:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:11510:x1869754974420864:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783137587.810364:0:5817:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783137587.810476:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:3.0:1783137587.810547:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.810563:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.810573:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.810582:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.810588:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.810594:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.810658:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783137587.810757:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+22:11510:x1869754974420864:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 2381us (2532us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1783137587.810767:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00000020:00080000:3.0:1783137587.810773:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783137587.815044:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137587.815057:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.815069:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137587.815073:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.815083:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.815110:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff970987960a00) 00010000:00010000:2.0:1783137587.815113:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783137587.815119:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137587.815124:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6755d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137587.815948:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137587.815952:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137587.815955:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137588.711171:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137589.159310:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b1e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990143360:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.159377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137589.159427:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b1e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990143872:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.159454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137589.159495:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783137589.159502:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b1e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990143232:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.159528:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137589.159551:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b1e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990143744:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.159573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137589.159604:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b1e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990143488:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.159627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137589.159644:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137589.159650:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b1e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990143616:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.159670:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137589.159697:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990143360 00000100:00100000:0.0:1783137589.159703:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990143360 00000100:00100000:0.0:1783137589.159902:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990143744 00000100:00100000:0.0:1783137589.159906:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990143744 00000100:00100000:0.0:1783137589.159928:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990143488 00000100:00100000:0.0:1783137589.159931:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990143488 00000100:00100000:0.0:1783137589.159947:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783137589.159955:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990143360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160019:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990143360:12345-0@lo:400:kworker.0 Request processed in 64us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137589.160026:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783137589.160040:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783137589.160046:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990143744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160074:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990143744:12345-0@lo:400:kworker.0 Request processed in 28us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137589.160080:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783137589.160091:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783137589.160106:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990143488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160140:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990143488:12345-0@lo:400:kworker.0 Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137589.160145:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783137589.160164:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990143872 00000100:00100000:0.0:1783137589.160168:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990143872 00000100:00100000:0.0:1783137589.160190:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990143616 00000100:00100000:0.0:1783137589.160193:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990143616 00000100:00100000:0.0:1783137589.160217:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783137589.160223:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869754990143872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160251:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869754990143872:12345-0@lo:400:kworker.0 Request processed in 28us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137589.160256:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783137589.160265:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783137589.160270:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1869754990143616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160291:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1869754990143616:12345-0@lo:400:kworker.0 Request processed in 21us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137589.160297:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783137589.160311:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990143232 00000100:00100000:0.0:1783137589.160314:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990143232 00000100:00100000:0.0:1783137589.160335:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1783137589.160340:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990143232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160364:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3307:x1869754990143232:12345-0@lo:400:kworker.0 Request processed in 24us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137589.160370:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1783137589.160416:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b1e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990143616:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160434:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b1e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990143488:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160456:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b1e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73e4795b-54a4-4490-bb2a-864b21234c99:3307:1869754990143232:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160464:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b1e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990143744:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160473:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b1e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990143360:0@lo:400:kworker.0 00000100:00100000:0.0:1783137589.160481:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b1e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990143872:0@lo:400:kworker.0 00000100:00080000:1.0:1783137589.160578:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137589.160582:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137589.160585:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1783137589.606885:0:12402:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137589.606896:0:12402:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137589.606939:0:12402:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:2.0:1783137589.606946:0:12402:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137589.672631:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137589.672653:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990144000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137589.672718:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137589.672780:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990144000 00000100:00100000:3.0:1783137589.672787:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990144000 00000100:00100000:3.0:1783137589.672859:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783137589.672866:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990144000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137589.672899:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137589.673104:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990144000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 238us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137589.673112:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783137589.673285:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990144000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137589.719084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137589.719180:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974421120 00000100:00100000:1.0:1783137589.719197:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974421120 00000100:00100000:1.0:1783137589.719266:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00100000:1.0:1783137589.719276:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+22:11528:x1869754974421120:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1783137589.719299:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137589.719318:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac6755de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.719564:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.719578:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.719590:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137589.719602:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1783137589.719767:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac6755de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a84 expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.719784:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a84 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.719826:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:1.0:1783137589.719829:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137589.719833:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d600, rc 0) 00000100:00100000:1.0:1783137589.719886:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:11528:x1869754974421120:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 610us (810us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1783137589.719894:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 187 00000100:00080000:0.0:1783137589.720114:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137589.723055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137589.723129:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974421248 00000100:00100000:1.0:1783137589.723138:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974421248 00000100:00100000:1.0:1783137589.723306:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 188 00000100:00100000:1.0:1783137589.723317:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:11528:x1869754974421248:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:1.0:1783137589.723388:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723405:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723417:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723431:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723438:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723446:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723721:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723730:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723737:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137589.723774:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723841:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723849:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723856:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723862:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137589.723866:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723874:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723886:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:1.0:1783137589.723889:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137589.723895:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723900:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac6755f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723911:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723917:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723923:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723934:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137589.723938:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723944:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723953:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970990e51e00) 00010000:00010000:1.0:1783137589.723956:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137589.723959:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723964:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac6755fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723977:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723984:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723990:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.723995:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137589.724009:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.724015:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.724033:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51b00) 00010000:00010000:1.0:1783137589.724035:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137589.724038:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.724043:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675601 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137589.724107:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:11528:x1869754974421248:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 791us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137589.724115:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 188 00010000:00010000:1.0:1783137589.743857:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137589.789407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137589.789484:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974421504 00000100:00100000:1.0:1783137589.789493:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974421504 00000100:00100000:1.0:1783137589.789550:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:1.0:1783137589.789560:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:11531:x1869754974421504:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1783137589.789580:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137589.789599:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675608 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a8b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.789667:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.789681:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.789692:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.789726:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.789734:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.789753:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790099:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790109:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790116:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137589.790125:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783137589.790344:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790352:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790360:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790366:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137589.790371:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790389:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790403:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:1.0:1783137589.790406:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137589.790411:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790417:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67560f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790429:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790435:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790441:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790446:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137589.790449:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790455:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790461:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970990e51b00) 00010000:00010000:1.0:1783137589.790464:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137589.790467:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790482:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790525:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c800/0x88def104ac675608 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a8b expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790540:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a8b expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.790546:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:1.0:1783137589.790548:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137589.790551:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d000, rc 0) 00000100:00100000:1.0:1783137589.790611:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:11531:x1869754974421504:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 1053us (1211us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1783137589.790619:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 189 00000100:00100000:1.0:1783137589.804014:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137589.804954:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974421632 00000100:00100000:3.0:1783137589.804965:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974421632 00000100:00100000:3.0:1783137589.805033:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 190 00000100:00100000:3.0:1783137589.805043:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:11531:x1869754974421632:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:2.0:1783137589.805141:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.805231:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.805247:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.805274:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.805282:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.805289:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.805295:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137589.805312:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.805321:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.805332:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:2.0:1783137589.805335:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137589.805339:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.805629:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac67562b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137589.805751:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:11531:x1869754974421632:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 707us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137589.805761:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 190 00000100:00100000:0.0:1783137589.814527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137589.814592:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974421888 00000100:00100000:2.0:1783137589.814602:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974421888 00000100:00100000:2.0:1783137589.814662:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:2.0:1783137589.814672:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:11531:x1869754974421888:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137589.814924:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:11531:x1869754974421888:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 253us (407us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783137589.814932:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:2.0:1783137589.861159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137589.861241:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974422144 00000100:00100000:3.0:1783137589.861250:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974422144 00000100:00100000:3.0:1783137589.861312:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:3.0:1783137589.861322:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:11057:x1869754974422144:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:3.0:1783137589.861357:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137589.861377:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675632 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a92 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137589.861471:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137589.861485:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a8b expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137589.861493:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137589.861538:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a8b expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137589.861550:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a8b expref: 28 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137589.861562:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990144128:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137589.861650:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b32540 going to sleep for 11 seconds 00000100:00100000:3.0:1783137589.863510:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990144128:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137589.863535:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137589.867824:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137589.867929:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974422272 00000100:00100000:0.0:1783137589.867938:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974422272 00010000:00010000:0.0:1783137589.867977:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a8b expref: 29 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137589.868026:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 74 00000100:00100000:0.0:1783137589.868036:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:2351:x1869754974422272:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137589.868051:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137589.868058:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a8b expref: 29 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.868071:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a8b expref: 29 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.868092:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67561d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a8b expref: 29 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.868120:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:0.0:1783137589.868125:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.868134:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.868141:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.868171:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137589.868232:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:2351:x1869754974422272:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 197us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137589.868240:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 74 00010000:00010000:3.0:1783137589.869177:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137589.869189:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137589.869207:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783137589.869375:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675632 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a92 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137589.869392:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a92 expref: 28 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137589.869401:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:3.0:1783137589.869404:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783137589.869416:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004e00, rc 0) 00000100:00100000:3.0:1783137589.869467:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:11057:x1869754974422144:12345-192.168.203.36@tcp:101:bash.0 Request processed in 8146us (8317us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1783137589.869475:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 191 00000100:00100000:2.0:1783137589.873706:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137589.874043:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974422528 00000100:00100000:1.0:1783137589.874053:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974422528 00000100:00100000:1.0:1783137589.874112:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 192 00000100:00100000:1.0:1783137589.874122:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:11057:x1869754974422528:12345-192.168.203.36@tcp:36:bash.0 00010000:00010000:1.0:1783137589.874372:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.874387:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137589.874398:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783137589.874465:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1783137589.874492:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c32e1fca reply state 000000007b29798c transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137589.874501:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783137589.874549:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1783137589.874707:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:11057:x1869754974422528:12345-192.168.203.36@tcp:36:bash.0 Request processed in 585us (1018us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1783137589.874716:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 192 00000020:00080000:1.0:1783137589.874721:0:7113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1783137589.886939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137589.887290:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974422656 00000100:00100000:0.0:1783137589.887300:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974422656 00000100:00100000:0.0:1783137589.887363:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 193 00000100:00100000:0.0:1783137589.887374:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:11057:x1869754974422656:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137589.887398:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137589.887420:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67564e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72a99 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.887480:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67564e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a99 expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.887494:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67564e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a99 expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.887530:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:0.0:1783137589.887534:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137589.887537:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234200, rc 0) 00000100:00100000:0.0:1783137589.887600:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+33:11057:x1869754974422656:12345-192.168.203.36@tcp:101:bash.0 Request processed in 227us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137589.887606:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 193 00010000:00010000:2.0:1783137589.892412:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.892449:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.892457:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.892463:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137589.892468:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.892475:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.892492:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:2.0:1783137589.892496:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137589.892501:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137589.892507:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675647 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137589.899754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137589.901026:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974422784 00000100:00100000:0.0:1783137589.901037:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974422784 00000100:00100000:0.0:1783137589.901117:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:0.0:1783137589.901126:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:11057:x1869754974422784:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137589.901142:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137589.901161:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72aa0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783137589.901187:0:6619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a488532, atime: 0x6a488530, ctime: 0x6a488532, blocks: 0xb 00010000:00010000:0.0:1783137589.901205:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1783137589.901210:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137589.901218:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa0 expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.901233:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa0 expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137589.901244:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235000, rc 0) 00000100:00100000:0.0:1783137589.901310:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:11057:x1869754974422784:12345-192.168.203.36@tcp:101:bash.0 Request processed in 184us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137589.901329:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00080000:1.0:1783137589.902120:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137589.904540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137589.904638:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974422912 00000100:00100000:0.0:1783137589.904647:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974422912 00002000:00010000:0.0:1783137589.904686:0:6625:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1783137589.904691:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bc834e00 with x1869754974422912 ext(0->18446744073709551615) 00002000:00010000:0.0:1783137589.904702:0:6625:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709bc834e00. 00000100:00100000:0.0:1783137589.904881:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:0.0:1783137589.904892:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974422912:12345-192.168.203.36@tcp:10:bash.0 00002000:00010000:0.0:1783137589.905169:0:6625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783137589.905173:0:6625:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783137586 -> 1783137589 00002000:00010000:0.0:1783137589.905175:0:6625:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1783137584 -> 1783137584 00002000:00010000:0.0:1783137589.905177:0:6625:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783137586 -> 1783137589 00002000:00010000:0.0:1783137589.905179:0:6625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1783137589.906650:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2352:x1869754974422912:12345-192.168.203.36@tcp:10:bash.0 Request processed in 1751us (2109us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1783137589.906663:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00002000:00010000:1.0:1783137589.906669:0:6625:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1783137589.906672:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bc834e00 with x1869754974422912 ext(0->18446744073709551615) 00002000:00010000:1.0:1783137589.906682:0:6625:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709bc834e00. 00000100:00100000:3.0:1783137590.021486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137590.021922:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974423040 00000100:00100000:1.0:1783137590.021933:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974423040 00000100:00100000:1.0:1783137590.021991:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:1.0:1783137590.022012:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:11545:x1869754974423040:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:1.0:1783137590.022083:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022125:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022136:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022153:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022160:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022167:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022461:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022471:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022478:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137590.022515:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022527:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022533:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022549:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022555:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0cc00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137590.022559:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022567:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022590:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:1.0:1783137590.022594:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137590.022598:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022604:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67565c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022625:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022631:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022636:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022640:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137590.022642:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022656:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022664:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970990e51b00) 00010000:00010000:1.0:1783137590.022666:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137590.022668:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022673:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022684:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022689:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022703:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022708:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137590.022710:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022716:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022722:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:1.0:1783137590.022724:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137590.022726:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.022919:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac67566a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.023005:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:11545:x1869754974423040:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 985us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137590.023014:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 194 00000100:00100000:2.0:1783137590.071654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.071758:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974423296 00000100:00100000:0.0:1783137590.071767:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974423296 00000100:00100000:0.0:1783137590.071842:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:0.0:1783137590.071852:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+32:11548:x1869754974423296:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137590.071873:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137590.071892:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675671 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72aa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.071963:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.071978:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072017:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072034:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072041:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072048:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072366:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072376:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072383:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137590.072393:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783137590.072482:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072489:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072495:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072500:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137590.072510:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072517:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072529:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137590.072532:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137590.072536:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072542:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675678 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072554:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072559:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072564:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072569:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137590.072572:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072577:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072585:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9709860f4900) 00010000:00010000:0.0:1783137590.072587:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137590.072596:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072601:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67567f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072641:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675671 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa7 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072653:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa7 expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.072660:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:0.0:1783137590.072663:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783137590.072665:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234a00, rc 0) 00000100:00100000:0.0:1783137590.072738:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:11548:x1869754974423296:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 887us (1093us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1783137590.072746:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 195 00000100:00100000:2.0:1783137590.075425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137590.075524:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974423424 00000100:00100000:1.0:1783137590.075533:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974423424 00000100:00100000:1.0:1783137590.075587:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 196 00000100:00100000:1.0:1783137590.075597:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:11548:x1869754974423424:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:1.0:1783137590.075661:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.075685:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a92 expref: 34 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.075694:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.075725:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a92 expref: 34 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.075749:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a92 expref: 34 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.075764:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc835500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990144256:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137590.075880:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137590.084867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.084961:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974423680 00000100:00100000:0.0:1783137590.084971:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974423680 00000100:00100000:0.0:1783137590.085046:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:0.0:1783137590.085055:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:5568:x1869754974423680:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783137590.085361:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:5568:x1869754974423680:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 305us (501us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1783137590.085370:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:2.0:1783137590.086759:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc835500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990144256:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137590.086786:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.088689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137590.088845:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974423808 00000100:00100000:3.0:1783137590.088854:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974423808 00010000:00010000:3.0:1783137590.088888:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a92 expref: 36 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137590.088976:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 75 00000100:00100000:3.0:1783137590.088986:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:2351:x1869754974423808:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137590.089012:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137590.089019:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a92 expref: 36 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.089032:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a92 expref: 36 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.089054:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675639 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a92 expref: 36 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.089068:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:3.0:1783137590.089073:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.089082:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.089107:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.089138:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137590.089191:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:2351:x1869754974423808:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 205us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137590.089198:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 75 00010000:00010000:2.0:1783137590.089914:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.089938:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.089966:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.089973:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.089981:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.089986:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137590.089990:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.090007:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.090019:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:2.0:1783137590.090022:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137590.090027:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.090032:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c000/0x88def104ac675694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.090096:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:11548:x1869754974423424:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 14498us (14677us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137590.090105:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 196 00000100:00100000:2.0:1783137590.092015:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.092089:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974424064 00000100:00100000:0.0:1783137590.092106:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974424064 00000100:00100000:0.0:1783137590.092153:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:0.0:1783137590.092162:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+34:11548:x1869754974424064:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137590.092401:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:11548:x1869754974424064:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 238us (407us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1783137590.092408:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:1.0:1783137590.165389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.165528:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974424320 00000100:00100000:0.0:1783137590.165538:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974424320 00000100:00100000:0.0:1783137590.165595:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:0.0:1783137590.165605:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+35:11560:x1869754974424320:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1783137590.165627:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137590.165645:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67569b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72aae expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.165711:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.165726:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.165749:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.165763:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.165770:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.165776:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166124:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6756b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166140:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6756b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166147:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6756b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137590.166157:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1783137590.166345:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166353:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166360:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166366:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137590.166370:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166377:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166388:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137590.166391:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137590.166396:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166402:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166414:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166426:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166432:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166436:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137590.166440:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166446:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166454:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9709860f4900) 00010000:00010000:0.0:1783137590.166456:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137590.166459:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166464:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166503:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac67569b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aae expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166516:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6756b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aae expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.166523:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:0.0:1783137590.166525:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137590.166533:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234000, rc 0) 00000100:00100000:0.0:1783137590.166652:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:11560:x1869754974424320:12345-192.168.203.36@tcp:101:cat.0 Request processed in 1047us (1270us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1783137590.166660:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 197 00000100:00100000:1.0:1783137590.171540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.171607:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974424576 00000100:00100000:0.0:1783137590.171616:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974424576 00000100:00100000:0.0:1783137590.171667:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:0.0:1783137590.171678:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:11560:x1869754974424576:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1783137590.171956:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+38:11560:x1869754974424576:12345-192.168.203.36@tcp:35:cat.0 Request processed in 278us (422us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1783137590.171964:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 54 00000100:00100000:0.0:1783137590.187031:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990144384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137590.187442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137590.187822:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990144384 00000100:00100000:3.0:1783137590.187830:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990144384 00000100:00100000:3.0:1783137590.187883:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783137590.187893:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990144384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783137590.187928:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137590.187985:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990144384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137590.187991:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783137590.188189:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990144384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137590.189656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137590.189746:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974424832 00000100:00100000:3.0:1783137590.189754:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974424832 00000100:00100000:3.0:1783137590.189835:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 198 00000100:00100000:3.0:1783137590.189844:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+38:11561:x1869754974424832:12345-192.168.203.36@tcp:36:rm.0 00010000:00010000:3.0:1783137590.189893:0:7113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783137590.189917:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234000/0x88def104ac6756b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aae expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.189938:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa7 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.189948:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac67564e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a99 expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.189972:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970990e51e00) 00010000:00010000:3.0:1783137590.189981:0:7113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137590.190011:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.190023:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.190033:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.190047:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.190054:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.190060:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.190648:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.190659:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.190667:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137590.191538:0:7113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1783137590.191550:0:7113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346088757483ns, next at 347088754484ns, rc = 0 00010000:00010000:3.0:1783137590.191621:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191632:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191641:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191650:0:7113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191656:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191663:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191828:0:7113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137590.191849:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191856:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191862:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191868:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137590.191872:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191879:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191898:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970987960f00) 00010000:00010000:3.0:1783137590.191901:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783137590.191905:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191911:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6756cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191929:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191935:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191941:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191946:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137590.191948:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191954:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191962:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:3.0:1783137590.191964:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137590.191967:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.191973:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac6756be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137590.192004:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027818ff0 reply state 000000009ccad78c transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137590.192012:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137590.192194:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+37:11561:x1869754974424832:12345-192.168.203.36@tcp:36:rm.0 Request processed in 2348us (2541us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1783137590.192271:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 198 00010000:00010000:1.0:1783137590.193511:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137590.193522:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.193530:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137590.193534:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.193542:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.193555:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff970987960f00) 00010000:00010000:1.0:1783137590.193558:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783137590.193561:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.193566:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005800/0x88def104ac6756d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.193582:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137590.193583:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137590.193585:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137590.201085:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.201102:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.201110:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.201116:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137590.201120:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.201129:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.201145:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970987960100) 00010000:00010000:3.0:1783137590.201148:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137590.201153:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.201158:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6756c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.235227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.235338:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974425088 00000100:00100000:0.0:1783137590.235348:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974425088 00000100:00100000:0.0:1783137590.235406:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 199 00000100:00100000:0.0:1783137590.235417:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+36:11567:x1869754974425088:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137590.235442:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137590.235461:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6756da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72ab5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.235582:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.235596:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.235618:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.235632:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.235639:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.235645:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137590.236204:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1783137590.236352:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236362:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236370:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236401:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236409:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236415:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236421:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137590.236431:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236451:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236462:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137590.236465:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137590.236469:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236475:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6756e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783137590.236487:0:5816:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb3a8631 reply state 00000000fbfc96f5 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.236496:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783137590.236525:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6756da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ab5 expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236538:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ab5 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.236546:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9709860f4500) 00010000:00010000:0.0:1783137590.236549:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137590.236551:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235200, rc 0) 00000100:00100000:0.0:1783137590.236621:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+39:11567:x1869754974425088:12345-192.168.203.36@tcp:101:bash.0 Request processed in 1206us (1402us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783137590.236630:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 199 00010000:00010000:2.0:1783137590.238829:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.238845:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.238851:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.238856:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137590.238861:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.238868:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.238882:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9709860f4900) 00010000:00010000:2.0:1783137590.238885:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137590.238888:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.238894:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac6756e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.240711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137590.240827:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974425216 00000100:00100000:1.0:1783137590.240836:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974425216 00000100:00100000:1.0:1783137590.240901:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:1.0:1783137590.240910:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974425216:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1783137590.240926:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137590.240944:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72abc expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137590.240981:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783137590.241012:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1783137590.241016:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137590.241025:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72abc expref: 6 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.241041:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72abc expref: 6 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.241054:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c000, rc 0) 00000100:00100000:1.0:1783137590.241102:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974425216:12345-192.168.203.36@tcp:101:bash.0 Request processed in 194us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137590.241109:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00080000:0.0:1783137590.241345:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137590.248931:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.249162:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974425344 00000100:00100000:0.0:1783137590.249172:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974425344 00000100:00100000:0.0:1783137590.249231:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:0.0:1783137590.249242:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:11567:x1869754974425344:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137590.249378:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137590.249398:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72ac3 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.249442:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72abc expref: 7 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.249452:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137590.249457:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137590.249462:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.249494:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72abc expref: 7 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.249508:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72abc expref: 7 pid: 6618 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.249522:0:6619:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b1e22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6619:1869754990144512:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137590.249669:0:6619:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab2909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137590.257267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137590.257395:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974425472 00000100:00100000:1.0:1783137590.257404:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974425472 00010000:00010000:1.0:1783137590.257447:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72abc expref: 8 pid: 6618 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.257483:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:1.0:1783137590.257492:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974425472:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137590.257507:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137590.257526:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72abc expref: 8 pid: 6618 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.257571:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72abc expref: 8 pid: 6618 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.257594:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137590.257598:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137590.257605:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.257615:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.257647:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.257659:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709aff10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1869754990144640:192.168.203.36@tcp:105: 00000100:00100000:1.0:1783137590.257729:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709adee7300 going to sleep for 11 seconds 00000100:00100000:1.0:1783137590.262756:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709aff10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1869754990144640:192.168.203.36@tcp:105: 00010000:00010000:1.0:1783137590.262780:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137590.262869:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974425472:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 5376us (5607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137590.262879:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 76 00010000:00010000:0.0:1783137590.264660:0:6619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd6acb21/0x88def104ac6756fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72abc expref: 7 pid: 6618 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.264707:0:6619:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b1e22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6619:1869754990144512:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137590.264986:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.265014:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234c00, rc 0) 00000100:00100000:0.0:1783137590.265076:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:11567:x1869754974425344:12345-192.168.203.36@tcp:101:bash.0 Request processed in 15836us (16154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137590.265084:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:2.0:1783137590.275177:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.275495:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974425728 00000100:00100000:0.0:1783137590.275505:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974425728 00000100:00100000:0.0:1783137590.275570:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:0.0:1783137590.275580:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+38:11567:x1869754974425728:12345-192.168.203.36@tcp:35:bash.0 00000100:00100000:0.0:1783137590.275966:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+39:11567:x1869754974425728:12345-192.168.203.36@tcp:35:bash.0 Request processed in 386us (797us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1783137590.275975:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 55 00000100:00100000:3.0:1783137590.414773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137590.415200:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974425856 00000100:00100000:2.0:1783137590.415210:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974425856 00000100:00100000:2.0:1783137590.415276:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 200 00000100:00100000:2.0:1783137590.415300:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+39:11583:x1869754974425856:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137590.415326:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137590.415344:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67570b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72aca expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.415522:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.415547:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.415559:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137590.415617:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783137590.415621:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137590.415645:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.415669:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67570b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aca expref: 41 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.415687:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aca expref: 40 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.415695:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:2.0:1783137590.415698:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137590.415701:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051400, rc 0) 00000100:00100000:2.0:1783137590.416234:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+40:11583:x1869754974425856:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 933us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137590.416325:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 200 00000100:00100000:2.0:1783137590.426714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.427382:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974426112 00000100:00100000:0.0:1783137590.427392:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974426112 00000100:00100000:0.0:1783137590.427509:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 201 00000100:00100000:0.0:1783137590.427518:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+40:11583:x1869754974426112:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137590.427548:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137590.427567:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72ad1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.427672:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675720 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.427698:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.427710:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137590.427722:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783137590.427867:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ad1 expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.427887:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ad1 expref: 42 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.427895:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9709860f4500) 00010000:00010000:0.0:1783137590.427898:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137590.427902:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235e00, rc 0) 00000100:00100000:0.0:1783137590.427968:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+42:11583:x1869754974426112:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 451us (1263us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1783137590.427976:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 201 00000100:00100000:1.0:1783137590.430836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137590.430899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.431035:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974426240 00000100:00100000:0.0:1783137590.431045:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974426240 00000100:00100000:0.0:1783137590.431114:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:2.0:1783137590.431123:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974426496 00000100:00100000:0.0:1783137590.431127:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aff10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+42:2353:x1869754974426240:12345-192.168.203.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783137590.431129:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974426496 00010000:00010000:0.0:1783137590.431145:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137590.431168:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675720 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ad1 expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.431175:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 202 00000100:00100000:2.0:1783137590.431185:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+43:11583:x1869754974426496:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137590.431209:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9709860f4500) 00010000:00010000:0.0:1783137590.431214:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137590.431217:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137590.431233:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67572e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72ad8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.431323:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675735 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.431336:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.431346:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137590.431357:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:0.0:1783137590.431423:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aff10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+44:2353:x1869754974426240:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 299us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137590.431432:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00010000:00010000:2.0:1783137590.431482:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67572e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ad8 expref: 44 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.431498:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ad8 expref: 43 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.431506:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9709860f4500) 00010000:00010000:2.0:1783137590.431508:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783137590.431518:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050e00, rc 0) 00000100:00100000:2.0:1783137590.431701:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+43:11583:x1869754974426496:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 515us (800us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1783137590.431709:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 202 00000100:00100000:1.0:1783137590.440144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137590.440334:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974426624 00000100:00100000:2.0:1783137590.440343:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974426624 00000100:00100000:2.0:1783137590.440468:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:2.0:1783137590.440478:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+6:2351:x1869754974426624:12345-192.168.203.36@tcp:1:lfs.0 00010000:00010000:2.0:1783137590.440528:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.440611:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.440621:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137590.440625:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137590.440630:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.440669:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.440683:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 6 pid: 6619 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.440698:0:6618:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd262680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6618:1869754990144768:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137590.441181:0:6618:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709861d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1783137590.447873:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137590.447952:0:6618:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd262680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6618:1869754990144768:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137590.447977:0:6618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.448068:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974426752 00000100:00100000:1.0:1783137590.448075:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974426752 00002000:00100000:1.0:1783137590.448119:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9709b1e22a00 x1869754974426752/t0(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:496/0 lens 504/0 e 0 to 0 dl 1783137601 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783137590.448129:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709b1e22a00 with x1869754974426752 ext(0->8) 00010000:00010000:1.0:1783137590.448136:0:6624:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 7 pid: 6619 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.448150:0:6624:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 7 pid: 6619 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137590.448157:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9709b1e22a00 00000100:00100000:1.0:1783137590.448183:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:1.0:1783137590.448193:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974426752:12345-192.168.203.36@tcp:4:lfs.0 00000100:00100000:1.0:1783137590.449077:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2352:x1869754974426752:12345-192.168.203.36@tcp:4:lfs.0 Request processed in 882us (1211us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783137590.449087:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00002000:00100000:1.0:1783137590.449095:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9709b1e22a00 x1869754974426752/t4294967308(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:496/0 lens 504/448 e 0 to 0 dl 1783137601 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783137590.449104:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709b1e22a00 with x1869754974426752 ext(0->8) 00010000:00010000:1.0:1783137590.449110:0:6624:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 9 pid: 6619 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.449125:0:6624:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 9 pid: 6619 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783137590.449145:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9709b1e22a00 00000100:00100000:1.0:1783137590.453037:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137590.453389:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974426880 00000100:00100000:2.0:1783137590.453400:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974426880 00010000:00010000:2.0:1783137590.453439:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 9 pid: 6619 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.453482:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:2.0:1783137590.453500:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2351:x1869754974426880:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137590.453514:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783137590.453531:0:5800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783137590.453534:0:5800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783137589 00002000:00010000:2.0:1783137590.453536:0:5800:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783137590 00002000:00010000:2.0:1783137590.453538:0:5800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783137589 00010000:00010000:2.0:1783137590.453591:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 9 pid: 6619 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.453608:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 9 pid: 6619 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.453632:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675704 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ac3 expref: 9 pid: 6619 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.453648:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137590.453665:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137590.453670:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.453679:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.453869:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137590.453927:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974426880:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 427us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137590.453935:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 77 00010000:00010000:3.0:1783137590.454740:0:6618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.454753:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.455045:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.455054:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.455062:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.455069:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137590.455074:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.455082:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.455098:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.455118:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000601246c3/0x88def104ac675743 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137590.455230:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2351:x1869754974426624:12345-192.168.203.36@tcp:1:lfs.0 Request processed in 14751us (15093us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137590.455239:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:1.0:1783137590.462026:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.462139:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974427136 00000100:00100000:0.0:1783137590.462147:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974427136 00000100:00100000:0.0:1783137590.462198:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 56 00000100:00100000:0.0:1783137590.462207:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+43:11583:x1869754974427136:12345-192.168.203.36@tcp:35:lfs.0 00000004:00010000:0.0:1783137590.462507:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ad8 expref: 43 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137590.462755:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1783137590.462844:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1783137590.463137:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1783137590.463187:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.463202:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ab5 expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.463211:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.463243:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ab5 expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.465356:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ab5 expref: 47 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.465376:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b1e23800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1869754990144896:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137590.466700:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab290840 going to sleep for 11 seconds 00000100:00100000:0.0:1783137590.470174:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b1e23800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1869754990144896:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137590.470221:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.472049:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.472257:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974427264 00000100:00100000:0.0:1783137590.472267:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974427264 00010000:00010000:0.0:1783137590.472304:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ab5 expref: 48 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.472337:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:0.0:1783137590.472348:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+48:2351:x1869754974427264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137590.472362:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137590.472369:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ab5 expref: 48 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.472381:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ab5 expref: 48 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.472399:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6756ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ab5 expref: 48 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.472441:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9709860f4500) 00010000:00010000:0.0:1783137590.472445:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.472454:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.472462:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.472496:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137590.472553:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+47:2351:x1869754974427264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 201us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137590.472561:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 78 00010000:00010000:2.0:1783137590.473187:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.473197:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783137590.473318:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1783137590.473516:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1783137590.473622:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd262680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990145024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783137590.473673:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137590.473707:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff970989b7e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783137590.473867:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990145024 00000100:00100000:3.0:1783137590.473873:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990145024 00000100:00100000:3.0:1783137590.473918:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137590.473926:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1869754990145024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783137590.474008:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1869754990145024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137590.474015:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137590.474299:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd262680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990145024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783137590.475612:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1783137590.475697:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b1e23800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990145152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783137590.476088:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137590.476129:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab290900 going to sleep for 11 seconds 00000100:00100000:3.0:1783137590.476286:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990145152 00000100:00100000:3.0:1783137590.476293:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990145152 00000100:00100000:3.0:1783137590.476342:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137590.476350:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1869754990145152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783137590.476545:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5818:x1869754990145152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 193us (455us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1783137590.476553:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783137590.476724:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b1e23800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1869754990145152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783137590.476964:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1783137590.477016:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.477026:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.477048:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.477055:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137590.477059:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.477067:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.477082:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9709860f4500) 00010000:00010000:0.0:1783137590.477085:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783137590.477090:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.477096:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67574a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137590.478030:0:5818:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783137590.478132:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1783137590.478145:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346375352547ns, next at 347375350051ns, rc = 0 00000001:00080000:0.0:1783137590.478153:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1783137590.478192:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9709860f4500) 00010000:00010000:0.0:1783137590.478196:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783137590.478203:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac675735 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ad8 expref: 51 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.478329:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:11583:x1869754974427136:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 16122us (16312us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1783137590.478350:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 56 00000020:00080000:0.0:1783137590.478355:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783137590.480492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137590.480614:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974427392 00000100:00100000:3.0:1783137590.480623:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974427392 00000100:00100000:3.0:1783137590.480678:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:3.0:1783137590.480688:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+50:11583:x1869754974427392:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137590.480710:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137590.480756:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675751 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72adf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.480841:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72adf expref: 51 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.480855:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72adf expref: 51 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.480875:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:3.0:1783137590.480878:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783137590.480882:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004e00, rc 0) 00000100:00100000:3.0:1783137590.480927:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:11583:x1869754974427392:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 241us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137590.480935:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 203 00000100:00100000:2.0:1783137590.484592:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137590.484740:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974427648 00000100:00100000:3.0:1783137590.484749:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974427648 00000100:00100000:3.0:1783137590.484885:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:3.0:1783137590.484895:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+51:11583:x1869754974427648:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:3.0:1783137590.485115:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:11583:x1869754974427648:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 221us (532us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1783137590.485123:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 57 00000100:00100000:1.0:1783137590.578978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137590.579079:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974427776 00000100:00100000:2.0:1783137590.579089:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974427776 00000100:00100000:2.0:1783137590.579171:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:2.0:1783137590.579180:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:11593:x1869754974427776:12345-192.168.203.36@tcp:34:lfs.0 00010000:00010000:2.0:1783137590.579261:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579289:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579301:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579319:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579327:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579334:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579437:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579446:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579453:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137590.579503:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579516:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579522:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579539:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579545:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137590.579549:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579556:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579568:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:2.0:1783137590.579571:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137590.579575:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579581:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675758 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579594:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579600:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579606:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579611:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137590.579613:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579629:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.579638:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970990e98a00) 00010000:00010000:2.0:1783137590.579640:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137590.579644:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.580804:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050e00/0x88def104ac67575f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.580832:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.580839:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.580844:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.580850:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137590.580853:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.580860:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.580871:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:2.0:1783137590.580873:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137590.580877:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.580901:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.580982:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:11593:x1869754974427776:12345-192.168.203.36@tcp:34:lfs.0 Request processed in 1800us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137590.581002:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 204 00000100:00100000:1.0:1783137590.616756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137590.616944:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974428032 00000100:00100000:3.0:1783137590.616954:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974428032 00000100:00100000:3.0:1783137590.617064:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:3.0:1783137590.617074:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+52:11596:x1869754974428032:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137590.617092:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137590.617122:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac67576d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72ae6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617191:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617206:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617216:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617229:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617236:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617243:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617375:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617385:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617392:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137590.617401:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783137590.617536:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617552:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617559:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617565:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137590.617569:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617577:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617590:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:3.0:1783137590.617593:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137590.617597:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617602:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac675774 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617614:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617619:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617624:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617629:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137590.617637:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617643:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617660:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff970987960e00) 00010000:00010000:3.0:1783137590.617663:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137590.617666:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617671:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac67577b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617710:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac67576d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ae6 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617723:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ae6 expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.617730:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:3.0:1783137590.617732:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783137590.617734:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005200, rc 0) 00000100:00100000:3.0:1783137590.617842:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11596:x1869754974428032:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 769us (1093us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1783137590.617849:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 205 00000100:00100000:0.0:1783137590.622956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137590.623133:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974428160 00000100:00100000:1.0:1783137590.623143:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974428160 00000100:00100000:1.0:1783137590.623200:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 206 00000100:00100000:1.0:1783137590.623211:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11596:x1869754974428160:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:1.0:1783137590.623287:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.623303:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.623661:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.623690:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.623697:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.623704:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.623920:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0ce00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137590.623925:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.623933:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.623945:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137590.623948:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783137590.623952:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.623958:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0ce00/0x88def104ac675790 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.624228:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11596:x1869754974428160:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 1017us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137590.624237:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 206 00000100:00100000:1.0:1783137590.633664:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.633771:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974428416 00000100:00100000:0.0:1783137590.633780:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974428416 00000100:00100000:0.0:1783137590.633868:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:0.0:1783137590.633880:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+54:11596:x1869754974428416:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137590.634116:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11596:x1869754974428416:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 238us (472us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1783137590.634124:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 58 00000100:00100000:2.0:1783137590.703443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137590.703492:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974428672 00000100:00100000:2.0:1783137590.703501:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974428672 00000100:00100000:2.0:1783137590.703559:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:2.0:1783137590.703572:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11606:x1869754974428672:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1783137590.703596:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137590.703599:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783137590.703624:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac675712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aca expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.703642:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:2.0:1783137590.703655:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137590.703667:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675797 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72aed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.703761:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.703780:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ae6 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.703841:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.703876:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ae6 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.703890:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ae6 expref: 55 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.703903:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd263480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990145280:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137590.704009:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098ae2a480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137590.711426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137590.711458:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974428800 00000100:00100000:2.0:1783137590.711465:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974428800 00010000:00010000:2.0:1783137590.711501:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ae6 expref: 56 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.711536:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:2.0:1783137590.711546:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd261f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:2352:x1869754974428800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137590.711831:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137590.711840:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ae6 expref: 56 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.711855:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ae6 expref: 56 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.711893:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:2.0:1783137590.711898:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.711906:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.711912:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.711929:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137590.711972:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd261f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+56:2352:x1869754974428800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 427us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137590.711980:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 79 00010000:00010000:0.0:1783137590.716434:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005200/0x88def104ac675782 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ae6 expref: 55 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.716457:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd263480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1869754990145280:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137590.716479:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.716506:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.716513:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137590.716534:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783137590.716855:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050600/0x88def104ac675797 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aed expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.716890:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aed expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.716900:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137590.716903:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783137590.716906:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051000, rc 0) 00000100:00100000:0.0:1783137590.716965:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11606:x1869754974428672:12345-192.168.203.36@tcp:101:bash.0 Request processed in 13394us (16699us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1783137590.716973:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 207 00000100:00100000:2.0:1783137590.725044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137590.725172:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974429056 00000100:00100000:3.0:1783137590.725180:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974429056 00000100:00100000:3.0:1783137590.725227:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 208 00000100:00100000:3.0:1783137590.725235:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+55:11606:x1869754974429056:12345-192.168.203.36@tcp:36:bash.0 00010000:00010000:3.0:1783137590.725679:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.725695:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.725706:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137590.725880:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:3.0:1783137590.725903:0:5814:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c41137dc reply state 00000000dd0cfd20 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137590.725911:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137590.725983:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:11606:x1869754974429056:12345-192.168.203.36@tcp:36:bash.0 Request processed in 747us (946us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1783137590.726001:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 208 00000020:00080000:3.0:1783137590.726007:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783137590.728591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137590.728678:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974429184 00000100:00100000:2.0:1783137590.728688:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974429184 00000100:00100000:2.0:1783137590.728745:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 209 00000100:00100000:2.0:1783137590.728755:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:11606:x1869754974429184:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1783137590.728776:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137590.728819:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6757b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72af4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.728921:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.728935:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aed expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.728953:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.728960:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.728976:0:5815:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.729011:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aed expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137590.729022:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aed expref: 59 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137590.729035:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd262300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990145408:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137590.729112:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a0b2c780 going to sleep for 11 seconds 00010000:00010000:3.0:1783137590.730030:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.730042:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.730048:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.730054:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137590.730058:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.730065:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.730102:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:3.0:1783137590.730106:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137590.730109:0:3293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.730118:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.730124:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.735833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.735863:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974429312 00000100:00100000:0.0:1783137590.735871:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974429312 00010000:00010000:0.0:1783137590.735904:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aed expref: 59 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.735943:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:0.0:1783137590.735953:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:2351:x1869754974429312:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137590.735987:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137590.736008:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aed expref: 59 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.736021:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aed expref: 59 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.736042:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137590.736053:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.736062:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.736069:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.736098:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137590.736142:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:2351:x1869754974429312:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 190us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137590.736150:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 80 00010000:00010000:1.0:1783137590.736929:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac67579e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aed expref: 58 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.736948:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd262300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990145408:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137590.736968:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.736977:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.737010:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137590.737053:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783137590.737058:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137590.737088:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.737120:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6757b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72af4 expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.737133:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72af4 expref: 57 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.737140:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137590.737143:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137590.737145:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051400, rc 0) 00000100:00100000:1.0:1783137590.737200:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:11606:x1869754974429184:12345-192.168.203.36@tcp:101:bash.0 Request processed in 8447us (8618us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137590.737211:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 209 00000100:00100000:0.0:1783137590.742445:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137590.742765:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974429568 00000100:00100000:1.0:1783137590.742775:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974429568 00000100:00100000:1.0:1783137590.742844:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 59 00000100:00100000:1.0:1783137590.742855:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+57:11606:x1869754974429568:12345-192.168.203.36@tcp:35:bash.0 00000100:00100000:1.0:1783137590.743090:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:11606:x1869754974429568:12345-192.168.203.36@tcp:35:bash.0 Request processed in 225us (642us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1783137590.743099:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 59 00010000:00010000:0.0:1783137590.759640:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783137590.782462:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1783137590.782481:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1783137590.782488:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1783137590.865229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137590.865325:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974429696 00000100:00100000:3.0:1783137590.865333:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974429696 00000100:00100000:3.0:1783137590.865389:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 210 00000100:00100000:3.0:1783137590.865399:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+58:11612:x1869754974429696:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137590.865421:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137590.865439:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72afb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.865500:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac6757c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.865514:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac6757c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.865524:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac6757c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137590.865602:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783137590.865606:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137590.865629:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac6757c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.865654:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72afb expref: 60 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.865672:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac6757c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72afb expref: 59 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.865682:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:3.0:1783137590.865684:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137590.865687:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004400, rc 0) 00000100:00100000:3.0:1783137590.865757:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11612:x1869754974429696:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 359us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137590.865764:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 210 00000100:00100000:1.0:1783137590.871431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.871527:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974429824 00000100:00100000:0.0:1783137590.871535:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974429824 00000100:00100000:0.0:1783137590.871600:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 211 00000100:00100000:0.0:1783137590.871610:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11612:x1869754974429824:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137590.871629:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137590.871647:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6757cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b02 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871701:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871716:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871736:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871764:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871772:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871779:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871890:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871898:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871905:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137590.871937:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783137590.871941:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137590.871957:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871967:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871975:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.871981:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872011:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872017:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137590.872020:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872028:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872040:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:0.0:1783137590.872043:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137590.872046:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872052:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac6757d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872063:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872068:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872073:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872077:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137590.872079:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872094:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872102:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9709860f4600) 00010000:00010000:0.0:1783137590.872104:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137590.872107:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872112:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6757dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872139:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6757cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872150:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.872156:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137590.872158:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137590.872160:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235200, rc 0) 00000100:00100000:0.0:1783137590.872215:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11612:x1869754974429824:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 607us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137590.872223:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 211 00000100:00100000:0.0:1783137590.882502:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.882548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137590.884176:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974430080 00000100:00100000:3.0:1783137590.884190:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974430080 00000100:00100000:3.0:1783137590.884253:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 212 00000100:00100000:3.0:1783137590.884264:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11612:x1869754974430080:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:3.0:1783137590.884283:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137590.884302:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6757eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.884393:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.884427:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72af4 expref: 61 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.884436:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.884443:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.884477:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.884488:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 61 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137590.884502:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990145536:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137590.884602:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72af4 expref: 61 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137590.884611:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72af4 expref: 61 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137590.884620:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990145664:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137590.884644:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff970982d37e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137590.885589:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974430208 00000100:00100000:1.0:1783137590.885598:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974430208 00010000:00010000:1.0:1783137590.885632:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 62 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.885665:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:1.0:1783137590.885674:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:2352:x1869754974430208:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137590.885686:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137590.885692:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 62 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.885703:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 62 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.885734:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137590.885739:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.885748:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.885754:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137590.885787:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:2352:x1869754974430208:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 115us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137590.885824:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:0.0:1783137590.889898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.889925:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974430336 00000100:00100000:0.0:1783137590.889932:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974430336 00010000:00010000:0.0:1783137590.889996:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72af4 expref: 62 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137590.890035:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:0.0:1783137590.890044:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:2354:x1869754974430336:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137590.890057:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137590.890063:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72af4 expref: 62 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.890075:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72af4 expref: 62 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.890093:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137590.890099:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.890108:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.890114:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.890130:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137590.890183:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:2354:x1869754974430336:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 139us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137590.890190:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 82 00000040:00080000:3.0:1783137590.891256:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137590.891264:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137590.893351:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1783137590.893373:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783137590.893560:0:5814:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.36@tcp) returned -22 from blocking AST (req@0000000019f38487 x1869754990145536) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 61 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.893612:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac6757e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b02 expref: 61 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.893627:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990145536:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137590.893646:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac6757ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72af4 expref: 60 pid: 5815 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137590.893656:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990145664:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137590.893676:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137590.893683:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.893692:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.893699:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137590.893716:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783137590.894352:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004000/0x88def104ac6757eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b09 expref: 61 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.894382:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b09 expref: 60 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.894390:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137590.894402:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137590.894405:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005c00, rc 0) 00000100:00100000:1.0:1783137590.894474:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11612:x1869754974430080:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 10211us (11980us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1783137590.894483:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 212 00000100:00100000:0.0:1783137590.899513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137590.899598:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974430592 00000100:00100000:1.0:1783137590.899608:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974430592 00000100:00100000:1.0:1783137590.899671:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:1.0:1783137590.899680:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11612:x1869754974430592:12345-192.168.203.36@tcp:103:lfs.0 00010000:00010000:1.0:1783137590.899694:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137590.899718:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004e00/0x88def104ac675751 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72adf expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137590.899748:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137590.899753:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137590.899845:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11612:x1869754974430592:12345-192.168.203.36@tcp:103:lfs.0 Request processed in 165us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137590.899853:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1783137590.902027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137590.902257:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974430720 00000100:00100000:0.0:1783137590.902267:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974430720 00000100:00100000:0.0:1783137590.902329:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 213 00000100:00100000:0.0:1783137590.902338:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11612:x1869754974430720:12345-192.168.203.36@tcp:58:lfs.0 00010000:00010000:0.0:1783137590.902438:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.902455:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.902467:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783137590.902704:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1783137590.902785:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11612:x1869754974430720:12345-192.168.203.36@tcp:58:lfs.0 Request processed in 446us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137590.902949:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 213 00000100:00100000:0.0:1783137590.907559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137590.910492:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974430848 00000100:00100000:1.0:1783137590.910506:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974430848 00000100:00100000:0.0:1783137590.911932:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:0.0:1783137590.911945:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+59:11612:x1869754974430848:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137590.911964:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137590.912007:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b10 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.912372:0:7113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.912384:0:7113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675807 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b10 expref: 60 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.912404:0:7113:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.912435:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675807 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b10 expref: 60 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.912448:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137590.912452:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137590.912455:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675807 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b10 expref: 60 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137590.912464:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235800, rc 0) 00000100:00100000:0.0:1783137590.912532:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11612:x1869754974430848:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 588us (4983us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137590.912540:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 214 00000100:00100000:3.0:1783137591.609631:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137591.609677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137591.609714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137591.609745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137591.609775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137591.609776:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974431488 00000100:00100000:1.0:1783137591.609787:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974431488 00000100:00080000:3.0:1783137591.609858:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137591.609880:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974431104 00000100:00100000:1.0:1783137591.609884:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974431104 00000100:00100000:3.0:1783137591.609899:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 150 00000100:00100000:3.0:1783137591.609913:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974431488:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137591.609920:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:1.0:1783137591.609930:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:2352:x1869754974431104:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137591.610042:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2352:x1869754974431488:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 133us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137591.610048:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:2352:x1869754974431104:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 117us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137591.610054:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 150 00000100:00080000:3.0:1783137591.610076:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137591.610088:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 151 00000100:00100000:2.0:1783137591.610116:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974430976 00000100:00100000:2.0:1783137591.610122:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974430976 00000100:00100000:2.0:1783137591.610163:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 294 00000100:00100000:2.0:1783137591.610171:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974430976:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137591.610200:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974430976:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 31us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137591.610207:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 294 00000100:00100000:0.0:1783137591.610296:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974431232 00000100:00100000:0.0:1783137591.610301:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974431232 00000100:00100000:0.0:1783137591.610343:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974431360 00000100:00100000:0.0:1783137591.610346:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974431360 00000100:00100000:0.0:1783137591.610365:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:0.0:1783137591.610373:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2352:x1869754974431232:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137591.610403:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2352:x1869754974431232:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 31us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137591.610411:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:0.0:1783137591.610425:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:0.0:1783137591.610435:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974431360:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137591.610462:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2352:x1869754974431360:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 30us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137591.610481:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00080000:3.0:1783137591.610694:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783137591.785176:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783137591.911138:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137591.911148:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137591.911185:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1783137591.911191:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137591.912095:0:11579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990145792:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783137591.912196:0:11579:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ceb5780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137591.917852:0:11579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990145792:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783137591.919689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137591.919940:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974431616 00000100:00100000:3.0:1783137591.919948:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974431616 00000100:00100000:3.0:1783137591.920016:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 215 00000100:00100000:3.0:1783137591.920027:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11613:x1869754974431616:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783137591.920056:0:5814:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783137591.920308:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11613:x1869754974431616:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 282us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137591.920316:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 215 00000100:00100000:3.0:1783137591.927116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137591.927383:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974431744 00000100:00100000:1.0:1783137591.927393:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974431744 00000100:00100000:1.0:1783137591.927454:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 216 00000100:00100000:1.0:1783137591.927464:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11613:x1869754974431744:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783137591.927530:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927547:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927559:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927584:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927591:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927599:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927621:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927628:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927652:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137591.927690:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783137591.927694:0:7113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137591.927705:0:7113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927726:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927733:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927741:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927747:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0cc00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137591.927751:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927759:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927769:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:1.0:1783137591.927772:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137591.927776:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.927782:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67580e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928102:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928109:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928116:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928121:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137591.928124:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928130:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928138:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff970990e51900) 00010000:00010000:1.0:1783137591.928140:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137591.928143:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928149:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675815 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928163:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928169:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928174:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928183:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137591.928187:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928193:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928200:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137591.928202:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137591.928205:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.928210:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67581c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137591.928280:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11613:x1869754974431744:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 Request processed in 816us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137591.928288:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 216 00000100:00100000:1.0:1783137591.934545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137591.934638:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974432000 00000100:00100000:2.0:1783137591.934659:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974432000 00000100:00100000:2.0:1783137591.934716:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 217 00000100:00100000:2.0:1783137591.934727:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+60:11613:x1869754974432000:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137591.934748:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137591.934766:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675823 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b17 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.934884:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.934899:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.934910:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137591.934931:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783137591.935044:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.935053:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.935060:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.935065:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137591.935070:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.935077:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.935095:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:2.0:1783137591.935098:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783137591.935103:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.935110:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67582a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.935159:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675823 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b17 expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.935169:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:2.0:1783137591.935172:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137591.935176:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675823 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b17 expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.935186:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050200, rc 0) 00000100:00100000:2.0:1783137591.935248:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:11613:x1869754974432000:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 519us (707us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1783137591.935256:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 217 00000100:00100000:0.0:1783137591.939431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137591.939560:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974432128 00000100:00100000:1.0:1783137591.939580:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974432128 00000100:00100000:1.0:1783137591.939637:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 218 00000100:00100000:1.0:1783137591.939648:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:11613:x1869754974432128:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783137591.939679:0:5816:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783137591.939767:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:11613:x1869754974432128:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 121us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137591.939774:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 218 00000100:00100000:0.0:1783137591.950326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137591.950409:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974432384 00000100:00100000:2.0:1783137591.950425:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974432384 00000100:00100000:2.0:1783137591.950476:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 219 00000100:00100000:2.0:1783137591.950485:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:11613:x1869754974432384:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137591.950504:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137591.950507:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783137591.950530:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004400/0x88def104ac6757c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72afb expref: 61 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.950561:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:2.0:1783137591.950576:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137591.950590:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675838 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b1e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783137591.951260:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1783137591.951440:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67583f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.951454:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67583f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.951462:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67583f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.951507:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675838 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b1e expref: 63 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.951522:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67583f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b1e expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.951529:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff970990e98c00) 00010000:00010000:2.0:1783137591.951532:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137591.951535:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051400, rc 0) 00000100:00100000:2.0:1783137591.951867:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:11613:x1869754974432384:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 1381us (1547us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1783137591.951876:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 219 00000100:00100000:3.0:1783137591.965201:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137591.968688:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974432640 00000100:00100000:1.0:1783137591.968717:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974432640 00000100:00100000:1.0:1783137591.968859:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 220 00000100:00100000:1.0:1783137591.968870:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:11613:x1869754974432640:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783137591.968931:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137591.968969:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051400/0x88def104ac67583f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b1e expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969133:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff970990e98c00) 00010000:00010000:1.0:1783137591.969143:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137591.969162:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969174:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969182:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969223:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969230:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969237:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969306:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969313:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969326:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969332:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137591.969337:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969344:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969354:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:1.0:1783137591.969356:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137591.969360:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969366:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac67584d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969376:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969382:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969387:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969392:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137591.969394:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969409:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969418:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf51764a8 (ffff970990e51900) 00010000:00010000:1.0:1783137591.969430:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137591.969433:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.969438:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675854 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf51764a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137591.969525:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:11613:x1869754974432640:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 656us (4332us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783137591.969534:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 220 00000100:00100000:2.0:1783137591.971926:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137591.976972:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974432768 00000100:00100000:0.0:1783137591.976994:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974432768 00000100:00100000:0.0:1783137591.977056:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 221 00000100:00100000:0.0:1783137591.977067:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+61:11613:x1869754974432768:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137591.977087:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137591.977110:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67585b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b25 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137591.977144:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137591.977156:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137591.977167:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137591.977261:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235600/0x88def104ac67585b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b25 expref: 63 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137591.977278:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b25 expref: 62 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137591.977287:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:0.0:1783137591.977290:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783137591.977301:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234200, rc 0) 00000100:00100000:0.0:1783137591.977360:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:11613:x1869754974432768:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 295us (5443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137591.977368:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 221 00000100:00100000:0.0:1783137591.984704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137591.984827:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974433024 00000100:00100000:2.0:1783137591.984837:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974433024 00000100:00100000:2.0:1783137591.984883:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 222 00000100:00100000:2.0:1783137591.984893:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+62:11613:x1869754974433024:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783137591.984991:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.985007:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137591.985019:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783137591.985256:0:7113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1783137591.985267:0:7113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347882474345ns, next at 348882472278ns, rc = 0 00000004:00010000:2.0:1783137591.985716:0:7113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd90f7ef reply state 00000000ef8bf8ea transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137591.985829:0:7113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137591.985924:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+64:11613:x1869754974433024:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 1030us (1225us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1783137591.985932:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 222 00000100:00100000:0.0:1783137591.987869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00010000:00010000:3.0:1783137591.987933:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137591.987945:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137591.987951:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137591.988015:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974433152 00000100:00100000:1.0:1783137591.988024:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974433152 00000100:00100000:1.0:1783137591.988076:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 223 00000100:00100000:1.0:1783137591.988086:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+64:11613:x1869754974433152:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783137591.988091:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137591.988107:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137591.988110:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137591.988121:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.988123:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b2c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137591.988138:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:3.0:1783137591.988142:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783137591.988147:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137591.988153:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050200/0x88def104ac675869 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.988177:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b2c expref: 64 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.988190:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b2c expref: 64 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137591.988223:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:1.0:1783137591.988226:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137591.988229:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c200, rc 0) 00000100:00100000:1.0:1783137591.988280:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+64:11613:x1869754974433152:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 196us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137591.988287:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 223 00000100:00100000:0.0:1783137591.999245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137591.999460:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974433280 00000100:00100000:1.0:1783137591.999470:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974433280 00000100:00100000:1.0:1783137591.999524:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:1.0:1783137591.999535:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2353:x1869754974433280:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783137592.000066:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:2353:x1869754974433280:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 531us (829us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1783137592.000075:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:3.0:1783137592.002605:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137592.002835:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974433536 00000100:00100000:1.0:1783137592.002844:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974433536 00000100:00100000:1.0:1783137592.002888:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:1.0:1783137592.002898:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+64:11613:x1869754974433536:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783137592.003135:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+65:11613:x1869754974433536:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 237us (538us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1783137592.003143:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 60 00000100:00100000:3.0:1783137592.017633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137592.018521:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974433792 00000100:00100000:0.0:1783137592.018531:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974433792 00000100:00100000:0.0:1783137592.018591:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 224 00000100:00100000:0.0:1783137592.018600:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+65:11613:x1869754974433792:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137592.018692:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+65:11613:x1869754974433792:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 93us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137592.018701:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 224 00000100:00100000:2.0:1783137592.021921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137592.022018:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974433920 00000100:00100000:1.0:1783137592.022027:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974433920 00000100:00100000:1.0:1783137592.022086:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 225 00000100:00100000:1.0:1783137592.022096:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+65:11613:x1869754974433920:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137592.022127:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137592.022145:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac675877 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b33 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.022217:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67587e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.022231:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67587e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.022242:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67587e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137592.022274:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137592.022293:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67587e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.022317:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d000/0x88def104ac675877 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b33 expref: 67 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.022333:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67587e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b33 expref: 66 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.022342:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:1.0:1783137592.022345:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783137592.022348:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0cc00, rc 0) 00000100:00100000:1.0:1783137592.022401:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+66:11613:x1869754974433920:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 306us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137592.022408:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 225 00000100:00100000:3.0:1783137592.039053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137592.039261:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974434048 00000100:00100000:2.0:1783137592.039271:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974434048 00000100:00100000:2.0:1783137592.039321:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:2.0:1783137592.039332:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+10:2352:x1869754974434048:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137592.039348:0:6620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137592.039378:0:6620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b3a expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137592.039404:0:6620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a488537, blocks: 0x1 00010000:00010000:2.0:1783137592.039422:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1783137592.039427:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137592.039436:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b3a expref: 11 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.039453:0:6620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b3a expref: 11 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.039466:0:6620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051200, rc 0) 00000100:00100000:2.0:1783137592.039522:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:2352:x1869754974434048:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 191us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137592.039529:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:3.0:1783137592.042096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137592.042289:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974434304 00000100:00100000:0.0:1783137592.042298:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974434304 00000100:00100000:0.0:1783137592.042348:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 226 00000100:00100000:0.0:1783137592.042358:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+66:11613:x1869754974434304:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137592.042486:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+66:11613:x1869754974434304:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 129us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137592.042495:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 226 00000100:00100000:0.0:1783137592.044596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137592.044904:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974434432 00000100:00100000:1.0:1783137592.044913:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974434432 00000100:00100000:1.0:1783137592.045436:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:1.0:1783137592.045448:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1af6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:11613:x1869754974434432:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783137592.045465:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137592.045481:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b41 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.045511:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b3a expref: 12 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.045520:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137592.045524:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137592.045530:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 12 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.045640:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b3a expref: 12 pid: 6620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.045654:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b3a expref: 12 pid: 6620 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137592.045669:0:6619:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd0a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990145920:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137592.045755:0:6619:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a0b3ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137592.048408:0:6619:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd0a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990145920:192.168.203.36@tcp:104: 00010000:00010000:1.0:1783137592.048438:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 12 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.048471:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d000, rc 0) 00000100:00100000:1.0:1783137592.048524:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1af6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+12:11613:x1869754974434432:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 3079us (3936us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137592.048533:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:3.0:1783137592.050582:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137592.050671:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974434560 00000100:00100000:2.0:1783137592.050679:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974434560 00010000:00010000:2.0:1783137592.050725:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b3a expref: 12 pid: 6620 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137592.050764:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:2.0:1783137592.050780:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+12:2351:x1869754974434560:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137592.050822:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137592.050843:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b3a expref: 12 pid: 6620 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.050875:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b3a expref: 12 pid: 6620 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.050896:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018b4c2bd/0x88def104ac675885 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b3a expref: 12 pid: 6620 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.050912:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137592.050916:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137592.050924:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 11 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.050934:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 11 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.050969:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 11 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137592.050993:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd261500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5801:1869754990146048:192.168.203.36@tcp:105: 00000100:00100000:2.0:1783137592.051057:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099cf6e240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137592.055151:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd261500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5801:1869754990146048:192.168.203.36@tcp:105: 00010000:00010000:0.0:1783137592.055186:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137592.055242:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:2351:x1869754974434560:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 4463us (4665us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137592.055269:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:3.0:1783137592.055683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137592.055880:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974434688 00000100:00100000:2.0:1783137592.055887:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974434688 00002000:00100000:2.0:1783137592.055928:0:6625:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9709bd244e00 x1869754974434688/t0(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:498/0 lens 504/0 e 0 to 0 dl 1783137603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137592.055939:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd244e00 with x1869754974434688 ext(0->12) 00002000:00010000:2.0:1783137592.055951:0:6625:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709bd244e00 00000100:00100000:2.0:1783137592.055975:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:2.0:1783137592.055993:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+11:2351:x1869754974434688:12345-192.168.203.36@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783137592.056397:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2351:x1869754974434688:12345-192.168.203.36@tcp:4:lhsmtool_posix.0 Request processed in 414us (714us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783137592.056405:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00002000:00100000:2.0:1783137592.056413:0:6625:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9709bd244e00 x1869754974434688/t4294967320(0) o4->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:498/0 lens 504/448 e 0 to 0 dl 1783137603 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137592.056422:0:6625:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709bd244e00 with x1869754974434688 ext(0->12) 00002000:00010000:2.0:1783137592.056426:0:6625:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709bd244e00 00000100:00100000:3.0:1783137592.060929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137592.061068:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974434816 00000100:00100000:1.0:1783137592.061077:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974434816 00000100:00100000:1.0:1783137592.061379:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 227 00000100:00100000:1.0:1783137592.061391:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+66:11613:x1869754974434816:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783137592.095684:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967499 is committed 00000004:00080000:0.0:1783137592.095699:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1783137592.095729:0:5836:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9709ab2909c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1783137592.095733:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff970989b72700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9709ab290840 00000020:00080000:0.0:1783137592.095737:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff97098730ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9709886d7c00 00000100:00100000:3.0:1783137592.095957:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990146176:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783137592.096029:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137592.096078:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990146176 00000100:00100000:3.0:1783137592.096085:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990146176 00000100:00100000:3.0:1783137592.096127:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783137592.096135:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990146176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783137592.096167:0:6620:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1783137592.096198:0:6620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a488535, atime: 0x6a488536, ctime: 0x6a488535, blocks: 0xb 00010000:00010000:3.0:1783137592.096206:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.096222:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1783137592.096226:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137592.096232:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.096246:0:6620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.096256:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.096281:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.096296:0:6620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783137592.096737:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1869754990146176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 601us (707us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783137592.096744:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1783137592.096763:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783137592.096929:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137592.096934:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.096944:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137592.096947:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.096956:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.096972:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.096989:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8bb8f5c/0x88def104ac675893 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.097017:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137592.097019:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137592.097020:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137592.097047:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1783137592.097052:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709bc835180, transno 4294967307 00000004:00080000:3.0:1783137592.097061:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1783137592.097081:0:3306:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9709bd245f80 x1869754990146176/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783137608 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783137592.097092:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709bd245f80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783137592.097358:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990146176:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1783137592.097624:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:0.0:1783137592.097647:0:5836:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9709adee7a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1783137592.097650:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9709bd79cb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97098ddf1000 00000020:00080000:0.0:1783137592.097654:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9709bd79ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9709bd2aa800 00000020:00080000:0.0:1783137592.097665:0:5836:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1783137592.097672:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1783137592.097708:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1783137592.097737:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1783137592.097918:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1783137592.098136:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990146432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783137592.098360:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:11613:x1869754974434816:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 Request processed in 36970us (37438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137592.098370:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 227 00000100:00100000:0.0:1783137592.098443:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990146304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783137592.098477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137592.098876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137592.098910:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990146304 00000100:00100000:3.0:1783137592.098916:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990146304 00000100:00100000:3.0:1783137592.098952:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990146432 00000100:00100000:3.0:1783137592.098955:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990146432 00000100:00100000:3.0:1783137592.098971:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783137592.098977:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1869754990146304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783137592.099008:0:6619:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1783137592.099030:0:6619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.099047:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa0 expref: 12 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.099054:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1783137592.099067:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783137592.099072:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.099099:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa0 expref: 12 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.099112:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa0 expref: 12 pid: 6619 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137592.099125:0:6619:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990146560:192.168.203.36@tcp:104: 00000100:00100000:1.0:1783137592.100478:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783137592.100495:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970988ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1869754990146432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783137592.100650:0:8200:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783137592.100654:0:8200:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783137591 00002000:00010000:1.0:1783137592.100656:0:8200:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783137592.100658:0:8200:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783137591 -> 1783137591 00002000:00010000:1.0:1783137592.100660:0:8200:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783137592.100730:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970988ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1869754990146432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 242us (1854us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1783137592.100737:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783137592.104059:0:6619:0:(client.c:2701:ptlrpc_set_wait()) set ffff970984f10a80 going to sleep for 11 seconds 00000004:00080000:3.0:1783137592.104131:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709bd245180/2, rc 0, transno 4294967321 00000100:00100000:3.0:1783137592.104141:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990146432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783137592.104368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137592.104436:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137592.104466:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974435072 00000100:00100000:0.0:1783137592.104472:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974435072 00010000:00010000:0.0:1783137592.104503:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa0 expref: 13 pid: 6619 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137592.104535:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:0.0:1783137592.104555:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2352:x1869754974435072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137592.104567:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137592.104573:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa0 expref: 13 pid: 6619 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.104587:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa0 expref: 13 pid: 6619 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.104611:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1783137592.104616:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1783137592.104621:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.104632:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.104652:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137592.104694:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+13:2352:x1869754974435072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 140us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137592.104702:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 84 00010000:00010000:3.0:1783137592.104925:0:6619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaae34ad/0x88def104ac675655 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72aa0 expref: 12 pid: 6619 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137592.104940:0:6619:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6619:1869754990146560:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137592.104959:0:6619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.104969:0:6619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.104977:0:6619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.105001:0:6619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.105008:0:6619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.105029:0:6619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783137592.105321:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137592.105327:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.105334:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137592.105338:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.105353:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.105365:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.105372:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000776fe6bf/0x88def104ac67589a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.105388:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137592.105390:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137592.105392:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137592.105824:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974434944 00000100:00100000:1.0:1783137592.105830:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974434944 00000100:00100000:1.0:1783137592.105864:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:1.0:1783137592.105880:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+12:2352:x1869754974434944:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783137592.106069:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3307:x1869754990146304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7089us (7590us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1783137592.106077:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1783137592.107432:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1783137592.108754:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709bd246680/2, rc 0, transno 4294967322 00000100:00100000:0.0:1783137592.108773:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990146304:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1783137592.154940:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:2.0:1783137592.154957:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1783137592.154962:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1783137592.154968:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1783137592.154976:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:1.0:1783137592.155331:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974434944:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 Request processed in 49445us (50958us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137592.155342:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:0.0:1783137592.166463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137592.166553:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974435328 00000100:00100000:3.0:1783137592.166562:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974435328 00000100:00100000:3.0:1783137592.166616:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 228 00000100:00100000:3.0:1783137592.166626:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:11613:x1869754974435328:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783137592.166673:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137592.166698:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67587e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b33 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.166718:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:3.0:1783137592.166723:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137592.166749:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.166762:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.166788:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783137592.167069:0:5814:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f52ff7a7 reply state 00000000848cd867 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137592.167078:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783137592.167285:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:11613:x1869754974435328:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 659us (830us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1783137592.167293:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 228 00000100:00100000:2.0:1783137592.170410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137592.170499:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974435456 00000100:00100000:1.0:1783137592.170509:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974435456 00000100:00100000:1.0:1783137592.170567:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:1.0:1783137592.170578:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2351:x1869754974435456:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783137592.170827:0:6619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783137592.170831:0:6619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1783137591 -> 1783137590 00002000:00010000:1.0:1783137592.170834:0:6619:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783137590 00002000:00010000:1.0:1783137592.170836:0:6619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783137591 -> 1783137590 00002000:00010000:1.0:1783137592.170838:0:6619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783137592.170887:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974435456:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 311us (485us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1783137592.170895:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 69 00010000:00010000:3.0:1783137592.171515:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.171527:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.171534:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.171541:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137592.171545:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.171553:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.171569:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:3.0:1783137592.171572:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137592.171576:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.171600:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005a00/0x88def104ac6758a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137592.173909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137592.174267:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974435712 00000100:00100000:3.0:1783137592.174276:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974435712 00000100:00100000:3.0:1783137592.174516:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:3.0:1783137592.174529:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:11613:x1869754974435712:12345-192.168.203.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783137592.174593:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.174608:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b25 expref: 20 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.174617:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.174646:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b25 expref: 20 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.174658:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b25 expref: 20 pid: 7113 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137592.174671:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7eb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990146688:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137592.174758:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade91180 going to sleep for 11 seconds 00000100:00100000:3.0:1783137592.185896:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7eb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1869754990146688:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137592.185928:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137592.186141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137592.186514:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974435840 00000100:00100000:3.0:1783137592.186521:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974435840 00010000:00010000:3.0:1783137592.186554:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b25 expref: 21 pid: 7113 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137592.186593:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:3.0:1783137592.186603:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:2351:x1869754974435840:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137592.186618:0:8403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137592.186624:0:8403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b25 expref: 21 pid: 7113 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.186637:0:8403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b25 expref: 21 pid: 7113 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.186659:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675862 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b25 expref: 21 pid: 7113 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.186674:0:8403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:3.0:1783137592.186679:0:8403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.186687:0:8403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.186694:0:8403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.186865:0:8403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137592.186923:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:2351:x1869754974435840:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 321us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137592.186932:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 85 00010000:00010000:1.0:1783137592.190318:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.190333:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.190364:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.190371:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.190395:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.190400:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137592.190404:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.190412:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.190427:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:1.0:1783137592.190430:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783137592.190435:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.190441:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004c00/0x88def104ac6758a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137592.190667:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:11613:x1869754974435712:12345-192.168.203.36@tcp:55:lhsmtool_posix.0 Request processed in 16137us (16762us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783137592.190677:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 229 00000100:00100000:1.0:1783137592.199388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137592.204558:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974435968 00000100:00100000:2.0:1783137592.204572:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974435968 00000100:00100000:2.0:1783137592.204642:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:2.0:1783137592.204652:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2352:x1869754974435968:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783137592.204696:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.204955:0:6620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.204995:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783137592.204999:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783137592.205004:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.205041:0:6620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.205471:0:6620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 8 pid: 6619 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137592.205977:0:6620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd262d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6620:1869754990146816:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137592.206130:0:6620:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1783137592.216781:0:6620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd262d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6620:1869754990146816:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137592.216852:0:6620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137592.217172:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137592.217627:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974436096 00000100:00100000:0.0:1783137592.217635:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974436096 00010000:00010000:0.0:1783137592.217671:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 9 pid: 6619 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137592.217756:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:0.0:1783137592.217765:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+9:2351:x1869754974436096:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137592.217778:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137592.217833:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 9 pid: 6619 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.217861:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 9 pid: 6619 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.217884:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062722678/0x88def104ac67588c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b41 expref: 9 pid: 6619 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.217899:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137592.217903:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783137592.217908:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.217917:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.217948:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137592.218005:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974436096:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 240us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137592.218013:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 86 00010000:00010000:2.0:1783137592.218417:0:6620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.218430:0:6620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.218455:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.218488:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.218495:0:6620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.218502:0:6620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137592.218506:0:6620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.218514:0:6620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.218527:0:6620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.218534:0:6620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac6758af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137592.218615:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974435968:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 Request processed in 13962us (19233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137592.218622:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 70 00000100:00100000:1.0:1783137592.225606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137592.225706:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974436352 00000100:00100000:3.0:1783137592.225716:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974436352 00000100:00100000:2.0:1783137592.226157:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 230 00000100:00100000:2.0:1783137592.226169:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:11613:x1869754974436352:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783137592.226261:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.226276:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.226287:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.226619:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.226631:0:7113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b2c expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.226639:0:7113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.226671:0:7113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b2c expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.226684:0:7113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b2c expref: 20 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137592.226698:0:7113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd262d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990146944:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137592.226781:0:7113:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1783137592.233911:0:7113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd262d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990146944:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137592.233940:0:7113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137592.235836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137592.236062:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974436480 00000100:00100000:3.0:1783137592.236070:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974436480 00010000:00010000:3.0:1783137592.236107:0:8403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b2c expref: 21 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137592.236239:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:2.0:1783137592.236251:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:2352:x1869754974436480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137592.236266:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137592.236273:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b2c expref: 21 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.236286:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b2c expref: 21 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.236317:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c200/0x88def104ac675870 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b2c expref: 21 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.236333:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:2.0:1783137592.236338:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.236346:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.236354:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137592.236377:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137592.236428:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:2352:x1869754974436480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 179us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137592.236436:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 87 00010000:00010000:0.0:1783137592.237056:0:7113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.237066:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137592.237336:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1783137592.237613:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1783137592.237663:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1783137592.237907:0:7113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7113:1869754990147072:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783137592.237961:0:7113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137592.238004:0:7113:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137592.238112:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990147072 00000100:00100000:3.0:1783137592.238119:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990147072 00000100:00100000:3.0:1783137592.238278:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137592.238288:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7113:x1869754990147072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783137592.238379:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7113:x1869754990147072:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137592.238386:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783137592.238444:0:7113:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1783137592.238450:0:7113:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1783137592.238481:0:7113:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709bd245180, transno 4294967321 00000004:00080000:0.0:1783137592.238497:0:7113:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709bd246680, transno 4294967322 00000100:00100000:0.0:1783137592.238504:0:7113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7113:1869754990147072:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1783137592.239009:0:7113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1783137592.239066:0:7113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7113:1869754990147200:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783137592.239100:0:7113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137592.243556:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990147200 00000100:00100000:1.0:1783137592.243580:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990147200 00000100:00100000:0.0:1783137592.243592:0:7113:0:(client.c:2701:ptlrpc_set_wait()) set ffff970989b7e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783137592.243752:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783137592.243765:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7113:x1869754990147200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783137592.244068:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7113:x1869754990147200:12345-0@lo:1000:mdt00_003.0 Request processed in 306us (4967us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1783137592.244076:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137592.244277:0:7113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7113:1869754990147200:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1783137592.244384:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244395:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244403:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244410:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137592.244414:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244422:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244437:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9709860f4600) 00010000:00010000:0.0:1783137592.244447:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137592.244453:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244459:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244598:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244606:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244612:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244617:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137592.244620:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244626:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244635:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137592.244637:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783137592.244644:0:7113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b10 expref: 23 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244656:0:7113:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675807 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b10 expref: 23 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244665:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b10 expref: 23 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.244709:0:7113:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b10 expref: 23 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137592.245029:0:7113:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990147328:192.168.203.36@tcp:105: 00000100:00100000:0.0:1783137592.245154:0:7113:0:(client.c:2701:ptlrpc_set_wait()) set ffff970982f76f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137592.259076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137592.259212:0:7113:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7113:1869754990147328:192.168.203.36@tcp:105: 00010000:00010000:0.0:1783137592.259249:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259261:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675800 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259421:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259437:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259500:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259510:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259517:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259523:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259544:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137592.259548:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259556:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259566:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137592.259569:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137592.259573:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259579:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259588:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259594:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259599:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259603:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137592.259606:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259611:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259628:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137592.259631:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783137592.259634:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.259641:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051600/0x88def104ac6758b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137592.259875:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974436608 00000100:00100000:2.0:1783137592.259891:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974436608 00000100:00100000:2.0:1783137592.259944:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:2.0:1783137592.259954:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:11612:x1869754974436608:12345-192.168.203.36@tcp:49:lfs.0 00000100:00100000:2.0:1783137592.260079:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+24:11612:x1869754974436608:12345-192.168.203.36@tcp:49:lfs.0 Request processed in 126us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137592.260086:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 61 00000100:00100000:0.0:1783137592.260209:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:11613:x1869754974436352:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 34042us (34610us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1783137592.260217:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 230 00000020:00080000:0.0:1783137592.260221:0:7113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783137592.267759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137592.267858:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974436864 00000100:00100000:3.0:1783137592.267873:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974436864 00000100:00100000:3.0:1783137592.267937:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 62 00000100:00100000:3.0:1783137592.267947:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+23:11613:x1869754974436864:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783137592.268774:0:5818:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783137592.268931:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1783137592.268990:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.269006:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.269029:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.269038:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.269044:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.269049:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.269073:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783137592.269160:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+25:11613:x1869754974436864:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 1212us (1408us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1783137592.269170:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 62 00000020:00080000:3.0:1783137592.269175:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783137592.269243:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137592.269251:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.269359:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137592.269364:0:11060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.269372:0:11060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.269386:0:11060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff970987960600) 00010000:00010000:0.0:1783137592.269390:0:11060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783137592.269394:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.269399:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004a00/0x88def104ac6758cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.269430:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137592.269432:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137592.269434:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783137592.270685:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137592.270692:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137592.271522:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783137592.271534:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783137592.272043:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137592.272313:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974437120 00000100:00100000:2.0:1783137592.272321:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974437120 00000100:00100000:2.0:1783137592.272408:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:2.0:1783137592.272418:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+25:11612:x1869754974437120:12345-192.168.203.36@tcp:58:lfs.0 00000040:00080000:2.0:1783137592.272642:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1783137592.272914:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+25:11612:x1869754974437120:12345-192.168.203.36@tcp:58:lfs.0 Request processed in 496us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137592.272923:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 231 00000100:00100000:1.0:1783137592.306554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137592.306700:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974437248 00000100:00100000:0.0:1783137592.306708:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974437248 00000100:00100000:0.0:1783137592.306765:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 232 00000100:00100000:0.0:1783137592.306775:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+25:11616:x1869754974437248:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137592.306831:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137592.306852:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b48 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.306923:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.306939:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.306949:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.306964:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.306971:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.306988:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.307293:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.307311:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b09 expref: 26 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.307318:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.307361:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b09 expref: 26 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137592.307375:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b09 expref: 26 pid: 5814 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137592.307389:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990147456:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137592.307462:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff970982f76f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137592.318652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137592.319550:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1869754990147456:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137592.319581:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137592.320421:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974437504 00000100:00100000:2.0:1783137592.320431:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974437504 00000100:00100000:2.0:1783137592.320488:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:2.0:1783137592.320496:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:9953:x1869754974437504:12345-192.168.203.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783137592.320721:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:9953:x1869754974437504:12345-192.168.203.36@tcp:35:ldlm_bl.0 Request processed in 225us (2077us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1783137592.320729:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 63 00000100:00100000:1.0:1783137592.327523:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137592.327604:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974437632 00000100:00100000:3.0:1783137592.327613:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974437632 00010000:00010000:3.0:1783137592.327647:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b09 expref: 28 pid: 5814 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137592.327684:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:3.0:1783137592.327694:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:2352:x1869754974437632:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137592.327707:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137592.327714:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b09 expref: 28 pid: 5814 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.327744:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b09 expref: 28 pid: 5814 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.327765:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac6757f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b09 expref: 28 pid: 5814 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.327781:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:3.0:1783137592.327786:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.327846:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.327855:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137592.327881:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137592.327927:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+27:2352:x1869754974437632:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 235us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137592.327935:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 88 00010000:00010000:1.0:1783137592.328208:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328216:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137592.328258:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783137592.328262:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137592.328280:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328291:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328301:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328307:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328314:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328330:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137592.328334:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328351:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328361:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:1.0:1783137592.328364:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137592.328367:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328373:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac6758d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328385:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328391:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328396:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328401:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137592.328403:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328409:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328429:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9709860f4600) 00010000:00010000:1.0:1783137592.328431:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137592.328434:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328439:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac6758e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328471:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac6758d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b48 expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328482:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b48 expref: 26 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137592.328488:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137592.328490:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137592.328492:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235c00, rc 0) 00000100:00100000:1.0:1783137592.328530:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:11616:x1869754974437248:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 21757us (21986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137592.328537:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 232 00010000:00010000:3.0:1783137592.807335:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783137593.093331:0:12455:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783137593.093340:0:12455:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783137593.093404:0:12455:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783137593.093410:0:12455:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783137593.319193:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137593.319202:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137593.319262:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783137593.319270:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783137593.319506:0:11579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990147584:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783137593.319592:0:11579:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988b323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137593.322573:0:11579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11579:1869754990147584:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783137593.322911:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137593.323008:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974437760 00000100:00100000:1.0:1783137593.323016:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974437760 00000100:00080000:2.0:1783137593.323334:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137593.323508:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:1.0:1783137593.323520:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:11628:x1869754974437760:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783137593.323558:0:5815:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783137593.323656:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:11628:x1869754974437760:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 138us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137593.323664:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 233 00000100:00100000:3.0:1783137593.326247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137593.326429:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974438016 00000100:00100000:2.0:1783137593.326438:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974438016 00000100:00100000:2.0:1783137593.326493:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 234 00000100:00100000:2.0:1783137593.326505:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+26:11628:x1869754974438016:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137593.326523:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137593.326541:0:7113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b4f expref: -99 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.326634:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6758f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.326647:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6758f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.326659:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6758f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137593.326669:0:7113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783137593.326828:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051000/0x88def104ac6758ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b4f expref: 29 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.326846:0:7113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6758f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b4f expref: 28 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.326854:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:2.0:1783137593.326857:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783137593.326860:0:7113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051200, rc 0) 00000100:00100000:2.0:1783137593.326913:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:11628:x1869754974438016:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 410us (674us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1783137593.326936:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 234 00000100:00100000:2.0:1783137593.337641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137593.337685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137593.337910:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974438400 00000100:00100000:3.0:1783137593.337919:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974438400 00000100:00100000:3.0:1783137593.337980:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 235 00000100:00100000:3.0:1783137593.337990:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:11628:x1869754974438400:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783137593.338024:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974438144 00000100:00100000:0.0:1783137593.338036:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974438144 00000100:00100000:0.0:1783137593.338131:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:0.0:1783137593.338140:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd262d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:2352:x1869754974438144:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137593.338155:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137593.338188:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051200/0x88def104ac6758f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b4f expref: 29 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137593.338207:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137593.338211:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137593.338264:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd262d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:2352:x1869754974438144:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 124us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137593.338271:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00010000:00010000:2.0:1783137593.338425:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.338443:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.338453:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.338628:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.338636:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.338643:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.338649:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137593.338653:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.338661:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.338669:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:2.0:1783137593.338672:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783137593.338683:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137593.338690:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005c00/0x88def104ac675903 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137593.339599:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783137593.339606:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137593.340609:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783137593.340620:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137593.341272:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:11628:x1869754974438400:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 3107us (3408us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1783137593.341285:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 235 00000100:00100000:1.0:1783137593.345148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137593.345299:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974438656 00000100:00100000:2.0:1783137593.345307:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974438656 00000100:00100000:2.0:1783137593.345361:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 64 00000100:00100000:2.0:1783137593.345371:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+28:11628:x1869754974438656:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783137593.345601:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:11628:x1869754974438656:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 231us (460us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1783137593.345609:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 64 00010000:00010000:0.0:1783137593.833200:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137594.288294:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137594.288317:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd0a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990147712:0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.288389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137594.288455:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990147712 00000100:00100000:3.0:1783137594.288461:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990147712 00000100:00100000:3.0:1783137594.288498:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1783137594.288517:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990147712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.288564:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990147712:12345-0@lo:400:kworker.0 Request processed in 47us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137594.288571:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1783137594.288614:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd0a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990147712:0@lo:400:kworker.0 00000100:00100000:1.0:1783137594.289117:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990148096:0@lo:400:kworker.0 00000100:00100000:1.0:1783137594.289153:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137594.289264:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990147968:0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.289293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137594.289311:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137594.289317:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd0a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990147840:0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.289336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137594.289378:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990148096 00000100:00100000:3.0:1783137594.289383:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990148096 00000100:00100000:3.0:1783137594.289417:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783137594.289423:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1869754990148096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.289458:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1869754990148096:12345-0@lo:400:kworker.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137594.289476:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783137594.289497:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990147968 00000100:00100000:3.0:1783137594.289501:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990147968 00000100:00100000:3.0:1783137594.289537:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990147840 00000100:00100000:3.0:1783137594.289540:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990147840 00000100:00100000:3.0:1783137594.289556:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783137594.289562:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990147968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.289595:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990147968:12345-0@lo:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137594.289601:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783137594.289611:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783137594.289617:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990147840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.289640:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990147840:12345-0@lo:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137594.289646:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783137594.289672:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd0a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990147840:0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.289681:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990147968:0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.289978:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990148224:0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.290005:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137594.290033:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990148224 00000100:00100000:3.0:1783137594.290037:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990148224 00000100:00100000:3.0:1783137594.290058:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783137594.290064:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990148224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.290093:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990148224:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137594.290109:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783137594.290136:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990148224:0@lo:400:kworker.0 00000100:00100000:3.0:1783137594.290165:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137594.290171:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b18d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990148352:0@lo:400:kworker.0 00000100:00100000:1.0:1783137594.290288:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990148096:0@lo:400:kworker.0 00000100:00080000:2.0:1783137594.290383:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783137594.290388:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137594.290460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137594.291420:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990148352 00000100:00100000:1.0:1783137594.291428:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990148352 00000100:00100000:1.0:1783137594.291483:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783137594.291491:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1869754990148352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137594.291562:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1869754990148352:12345-0@lo:400:kworker.0 Request processed in 72us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137594.291569:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783137594.291603:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b18d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990148352:0@lo:400:kworker.0 00000100:00080000:2.0:1783137594.291734:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137594.791005:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b18d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990148480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137594.791072:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137594.791341:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990148480 00000100:00100000:3.0:1783137594.791350:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990148480 00000100:00100000:3.0:1783137594.791406:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783137594.791416:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869754990148480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137594.791449:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137594.791511:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869754990148480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137594.791518:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783137594.791599:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b18d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990148480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137594.856377:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137595.031114:0:12506:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783137595.031123:0:12506:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137595.031165:0:12506:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783137595.031171:0:12506:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783137595.201293:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137595.201498:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974438912 00000100:00100000:0.0:1783137595.201507:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974438912 00000100:00100000:0.0:1783137595.201574:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 236 00000100:00100000:0.0:1783137595.201583:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+29:11649:x1869754974438912:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137595.201607:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137595.201626:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67590a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b56 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137595.201739:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675911 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137595.201771:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675911 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137595.201781:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675911 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137595.201814:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783137595.201935:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac67590a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b56 expref: 32 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137595.201953:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675911 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b56 expref: 31 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137595.201971:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:0.0:1783137595.201974:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783137595.201978:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235200, rc 0) 00000100:00100000:0.0:1783137595.202039:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:11649:x1869754974438912:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 457us (755us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1783137595.202046:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 236 00000100:00080000:3.0:1783137595.202338:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137595.209946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137595.210384:0:7113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974439040 00000100:00100000:1.0:1783137595.210393:0:7113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974439040 00000100:00100000:1.0:1783137595.210445:0:7113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 237 00000100:00100000:1.0:1783137595.210456:0:7113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:11649:x1869754974439040:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:1.0:1783137595.210522:0:7113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137595.210548:0:7113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137595.210560:0:7113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137595.210586:0:7113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137595.210594:0:7113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137595.210601:0:7113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137595.210626:0:7113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0cc00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137595.210630:0:7113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137595.210637:0:7113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137595.210648:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137595.210651:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783137595.210656:0:7113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137595.210662:0:7113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac67591f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137595.210752:0:7113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:11649:x1869754974439040:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 287us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137595.210768:0:7113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 237 00000100:00100000:3.0:1783137595.307091:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137595.307112:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990148608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137595.307197:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137595.307332:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990148608 00000100:00100000:0.0:1783137595.307340:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990148608 00000100:00100000:0.0:1783137595.307397:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783137595.307405:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b1f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990148608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137595.307438:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137595.307490:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b1f72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1869754990148608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137595.307497:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783137595.307968:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990148608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137595.311519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137595.311604:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974439168 00000100:00100000:3.0:1783137595.311613:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974439168 00000100:00100000:3.0:1783137595.311691:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00100000:3.0:1783137595.311702:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2354:x1869754974439168:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:3.0:1783137595.311719:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137595.311739:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac675926 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b5d expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137595.311781:0:6619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a488536, atime: 0x6a488536, ctime: 0x6a488536, blocks: 0xb 00010000:00010000:3.0:1783137595.311827:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1783137595.311832:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137595.311842:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac675926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b5d expref: 8 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137595.311861:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac675926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b5d expref: 8 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137595.311873:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005a00, rc 0) 00000100:00100000:3.0:1783137595.311927:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2354:x1869754974439168:12345-192.168.203.36@tcp:101:cat.0 Request processed in 227us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137595.311934:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 71 00000100:00080000:0.0:1783137595.312381:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137595.316902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137595.317033:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974439296 00000100:00100000:2.0:1783137595.317044:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974439296 00002000:00100000:2.0:1783137595.317094:0:6626:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9709b18d2d80 x1869754974439296/t0(0) o3->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:501/0 lens 488/0 e 0 to 0 dl 1783137606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137595.317104:0:6626:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709b18d2d80 with x1869754974439296 ext(0->4095) 00002000:00010000:2.0:1783137595.317111:0:6626:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709b18d2d80 00000100:00100000:2.0:1783137595.317166:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:2.0:1783137595.317176:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b18d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2353:x1869754974439296:12345-192.168.203.36@tcp:3:cat.0 00000100:00100000:2.0:1783137595.317403:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b18d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2353:x1869754974439296:12345-192.168.203.36@tcp:3:cat.0 Request processed in 227us (509us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783137595.317411:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00002000:00100000:2.0:1783137595.317418:0:6626:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9709b18d2d80 x1869754974439296/t0(0) o3->d717cef4-1367-4dd9-ae68-a0c1ee666834@192.168.203.36@tcp:501/0 lens 488/4536 e 0 to 0 dl 1783137606 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783137595.317427:0:6626:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9709b18d2d80 with x1869754974439296 ext(0->4095) 00002000:00010000:2.0:1783137595.317431:0:6626:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9709b18d2d80 00010000:00010000:0.0:1783137595.885001:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783137595.890054:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1783137596.729630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137596.729669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137596.729700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137596.729721:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137596.729922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137596.729967:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974439680 00000100:00100000:3.0:1783137596.729975:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974439680 00000100:00100000:3.0:1783137596.730020:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974439808 00000100:00100000:3.0:1783137596.730023:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974439808 00000100:00100000:3.0:1783137596.730063:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:3.0:1783137596.730075:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974439680:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137596.730154:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+8:2351:x1869754974439680:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 81us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137596.730163:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:3.0:1783137596.730181:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:3.0:1783137596.730189:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974439808:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137596.730216:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974439808:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 30us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137596.730223:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:3.0:1783137596.730245:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974439936 00000100:00100000:3.0:1783137596.730248:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974439936 00000100:00100000:3.0:1783137596.730278:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974439552 00000100:00100000:3.0:1783137596.730281:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974439552 00000100:00100000:3.0:1783137596.730305:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 155 00000100:00100000:3.0:1783137596.730377:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974439936:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137596.730530:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2351:x1869754974439936:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 217us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137596.730538:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 155 00000100:00100000:3.0:1783137596.730552:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00100000:3.0:1783137596.730559:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:2351:x1869754974439552:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137596.730584:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+31:2351:x1869754974439552:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137596.730591:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 156 00000100:00080000:3.0:1783137596.730615:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137596.730619:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137596.734828:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974439424 00000100:00100000:1.0:1783137596.734845:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974439424 00000100:00100000:1.0:1783137596.734902:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 296 00000100:00100000:1.0:1783137596.734911:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974439424:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137596.734995:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2351:x1869754974439424:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 86us (5374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137596.735002:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 296 00010000:00010000:0.0:1783137596.903271:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783137597.434966:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1783137597.434987:0:5836:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9709bc952b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1783137597.434993:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9709838cbd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9709bc952c00 00000020:00080000:1.0:1783137597.434997:0:5836:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9709838cb700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9709bc973000 00000020:00080000:1.0:1783137597.435022:0:5836:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1783137597.435092:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1783137597.435276:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1783137597.440644:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1783137597.440660:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:0.0:1783137597.928114:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137598.951009:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137599.401598:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990148736:0@lo:400:kworker.0 00000100:00100000:0.0:1783137599.401680:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137599.401729:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990149248:0@lo:400:kworker.0 00000100:00100000:0.0:1783137599.401756:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137599.401781:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783137599.401787:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990149120:0@lo:400:kworker.0 00000100:00100000:0.0:1783137599.401830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137599.401860:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990148864:0@lo:400:kworker.0 00000100:00100000:0.0:1783137599.401882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137599.401900:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990149376:0@lo:400:kworker.0 00000100:00100000:0.0:1783137599.401921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137599.402291:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990149248 00000100:00100000:2.0:1783137599.402299:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990149248 00000100:00100000:2.0:1783137599.402344:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990148864 00000100:00100000:2.0:1783137599.402347:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990148864 00000100:00100000:2.0:1783137599.402385:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783137599.402394:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990149248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.402451:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990149248:12345-0@lo:400:kworker.0 Request processed in 59us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137599.402470:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783137599.402486:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783137599.402492:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990148864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.402517:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990148864:12345-0@lo:400:kworker.0 Request processed in 26us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137599.402536:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783137599.402554:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990148736 00000100:00100000:2.0:1783137599.402558:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990148736 00000100:00100000:2.0:1783137599.402582:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1783137599.402588:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990148736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.402618:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990148736:12345-0@lo:400:kworker.0 Request processed in 30us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137599.402624:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:2.0:1783137599.402655:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137599.402690:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990149120 00000100:00100000:2.0:1783137599.402693:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990149120 00000100:00100000:2.0:1783137599.402719:0:8200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990149376 00000100:00100000:2.0:1783137599.402722:0:8200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990149376 00000100:00100000:2.0:1783137599.402740:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783137599.402746:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bf236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990149120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.402775:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bf236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990149120:12345-0@lo:400:kworker.0 Request processed in 29us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137599.402781:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783137599.402811:0:8200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783137599.402818:0:8200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990149376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.402845:0:8200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990149376:12345-0@lo:400:kworker.0 Request processed in 28us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137599.402851:0:8200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1783137599.402869:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137599.402872:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137599.403225:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137599.403240:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990148992:0@lo:400:kworker.0 00000100:00100000:0.0:1783137599.403270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137599.403315:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990148864:0@lo:400:kworker.0 00000100:00100000:0.0:1783137599.403324:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1783137599.403329:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709bd245f80, transno 4294967310 00000100:00100000:0.0:1783137599.403341:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990149376:0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.409007:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990148992 00000100:00100000:2.0:1783137599.409020:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990148992 00000100:00100000:2.0:1783137599.409081:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783137599.409090:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990148992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.409176:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990148992:12345-0@lo:400:kworker.0 Request processed in 87us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137599.409183:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1783137599.409207:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137599.423867:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990148992:0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.425317:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1783137599.425324:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1783137599.425342:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990149120:0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.425354:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990148736:0@lo:400:kworker.0 00000100:00100000:2.0:1783137599.425365:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990149248:0@lo:400:kworker.0 00000100:00100000:3.0:1783137599.911023:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990149504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137599.911101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137599.911145:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990149504 00000100:00100000:0.0:1783137599.911155:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990149504 00000100:00100000:0.0:1783137599.911202:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783137599.911211:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990149504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137599.911243:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137599.911293:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990149504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137599.911300:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783137599.912085:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990149504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137599.981219:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137600.204568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137600.204843:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974440064 00000100:00100000:2.0:1783137600.204853:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974440064 00000100:00100000:2.0:1783137600.204951:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 238 00000100:00100000:2.0:1783137600.204961:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:11292:x1869754974440064:12345-192.168.203.36@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783137600.205061:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:11292:x1869754974440064:12345-192.168.203.36@tcp:60:lhsmtool_posix.0 Request processed in 101us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137600.205069:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 238 00000100:00080000:3.0:1783137600.206098:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137600.217869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137600.218014:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974440320 00000100:00100000:0.0:1783137600.218024:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974440320 00000100:00100000:0.0:1783137600.218086:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:0.0:1783137600.218098:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:11292:x1869754974440320:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783137600.220309:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:11292:x1869754974440320:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 2202us (2438us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1783137600.220322:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 65 00000100:00100000:1.0:1783137600.424814:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b78cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990149632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137600.424882:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137600.425098:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990149632 00000100:00100000:0.0:1783137600.425107:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990149632 00000100:00100000:0.0:1783137600.425152:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783137600.425161:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990149632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137600.425195:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137600.425260:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990149632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137600.425268:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783137600.425351:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b78cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990149632:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783137600.487068:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137600.487078:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137600.487374:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783137600.487381:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783137600.594101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137600.594190:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974440448 00000100:00100000:3.0:1783137600.594209:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974440448 00000100:00100000:3.0:1783137600.594290:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 239 00000100:00100000:3.0:1783137600.594299:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+5:12101:x1869754974440448:12345-192.168.203.36@tcp:101:lsof.0 00010000:00010000:3.0:1783137600.594320:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137600.594338:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac67592d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b64 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137600.594718:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac675934 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137600.594733:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac675934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137600.594746:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac675934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137600.594977:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783137600.594982:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137600.595053:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac675934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137600.595079:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004200/0x88def104ac67592d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b64 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137600.595107:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac675934 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b64 expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137600.595115:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98500) 00010000:00010000:3.0:1783137600.595118:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137600.595121:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004800, rc 0) 00000100:00100000:3.0:1783137600.595234:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:635ac0b3-e465-4842-aece-61b6c0568a2a+6:12101:x1869754974440448:12345-192.168.203.36@tcp:101:lsof.0 Request processed in 935us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137600.595243:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 239 00000100:00080000:2.0:1783137600.595721:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783137600.998956:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137601.849929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137601.849986:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137601.850018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137601.850038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137601.850054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137601.850079:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974441088 00000100:00100000:2.0:1783137601.850087:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974441088 00000100:00100000:2.0:1783137601.850131:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974440704 00000100:00100000:2.0:1783137601.850135:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974440704 00000100:00100000:2.0:1783137601.850154:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:2.0:1783137601.850163:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2354:x1869754974441088:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137601.850233:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2354:x1869754974441088:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137601.850241:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 160 00000100:00100000:2.0:1783137601.850257:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:2.0:1783137601.850263:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:2354:x1869754974440704:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137601.850296:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:2354:x1869754974440704:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137601.850302:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 161 00000100:00100000:2.0:1783137601.850323:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974440832 00000100:00100000:2.0:1783137601.850325:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974440832 00000100:00100000:2.0:1783137601.850355:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974440960 00000100:00100000:2.0:1783137601.850357:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974440960 00000100:00100000:2.0:1783137601.850376:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:2.0:1783137601.850384:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2354:x1869754974440832:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137601.850412:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2354:x1869754974440832:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137601.850428:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:2.0:1783137601.850455:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:2.0:1783137601.850462:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2354:x1869754974440960:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137601.850485:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2354:x1869754974440960:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137601.850491:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00080000:2.0:1783137601.850511:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137601.850515:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137601.850964:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974440576 00000100:00100000:1.0:1783137601.850970:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974440576 00000100:00100000:1.0:1783137601.851007:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 298 00000100:00100000:1.0:1783137601.851014:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2354:x1869754974440576:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137601.851059:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2354:x1869754974440576:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 45us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137601.851065:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 298 00010000:00010000:0.0:1783137602.024243:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783137602.519294:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1783137602.520045:0:5836:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783137602.520081:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1783137602.520091:0:5847:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1783137603.047003:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137604.073326:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137604.519044:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990150144:0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519114:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137604.519174:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990149760:0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519179:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990150016:0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137604.519207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137604.519224:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783137604.519230:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990149888:0@lo:400:kworker.0 00000100:00100000:0.0:1783137604.519230:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990150272:0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137604.519272:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990150400:0@lo:400:kworker.0 00000100:00100000:0.0:1783137604.519272:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990149760 00000100:00100000:0.0:1783137604.519279:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990149760 00000100:00100000:3.0:1783137604.519293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137604.519327:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990150016 00000100:00100000:0.0:1783137604.519330:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1783137604.519331:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990150016 00000100:00100000:0.0:1783137604.519352:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990149760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519362:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990149888 00000100:00100000:3.0:1783137604.519365:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990149888 00000100:00100000:3.0:1783137604.519380:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783137604.519386:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990150016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137604.519407:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990149760:12345-0@lo:400:kworker.0 Request processed in 56us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137604.519415:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1783137604.519418:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990150016:12345-0@lo:400:kworker.0 Request processed in 33us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137604.519431:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783137604.519443:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783137604.519445:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137604.519449:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990149888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137604.519473:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990149760:0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519475:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990149888:12345-0@lo:400:kworker.0 Request processed in 26us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137604.519480:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783137604.519488:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990150272 00000100:00100000:3.0:1783137604.519491:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990150272 00000100:00100000:3.0:1783137604.519507:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783137604.519513:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b78cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990150272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519555:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b78cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990150272:12345-0@lo:400:kworker.0 Request processed in 42us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137604.519561:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783137604.519582:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990150144 00000100:00100000:3.0:1783137604.519585:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990150144 00000100:00100000:3.0:1783137604.519608:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990150400 00000100:00100000:3.0:1783137604.519611:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990150400 00000100:00100000:3.0:1783137604.519643:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783137604.519650:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990150144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519683:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990150144:12345-0@lo:400:kworker.0 Request processed in 34us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137604.519689:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783137604.519700:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783137604.519716:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990150400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519744:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990150400:12345-0@lo:400:kworker.0 Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137604.519759:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783137604.519817:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990149888:0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519828:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990150400:0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519836:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990150016:0@lo:400:kworker.0 00000100:00100000:3.0:1783137604.519861:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990150144:0@lo:400:kworker.0 00000100:00080000:3.0:1783137604.519883:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137604.519888:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137604.519900:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137604.520533:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990150272:0@lo:400:kworker.0 00000100:00100000:2.0:1783137605.033608:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137605.033628:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990150528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137605.033689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137605.033752:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990150528 00000100:00100000:2.0:1783137605.033759:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990150528 00000100:00100000:2.0:1783137605.033823:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783137605.033831:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990150528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783137605.033873:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137605.033922:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990150528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137605.033929:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783137605.033974:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990150528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137605.095952:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783137605.166584:0:12714:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:00:03 (1783137603) 00000100:00100000:0.0:1783137605.548638:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990150656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137605.548708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137605.549276:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990150656 00000100:00100000:2.0:1783137605.549295:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990150656 00000100:00100000:2.0:1783137605.549351:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783137605.549362:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990150656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137605.549397:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137605.549474:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990150656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137605.549481:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783137605.549657:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990150656:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783137606.119057:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137606.968463:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137606.968492:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137606.968513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137606.968533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137606.968599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137606.968634:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974441472 00000100:00100000:2.0:1783137606.968644:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974441472 00000100:00100000:2.0:1783137606.968692:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974441600 00000100:00100000:2.0:1783137606.968696:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974441600 00000100:00100000:2.0:1783137606.968719:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:2.0:1783137606.968727:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974441472:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137606.968784:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2352:x1869754974441472:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 58us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137606.968809:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:2.0:1783137606.968824:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:2.0:1783137606.968830:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974441600:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137606.968850:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2351:x1869754974441600:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 20us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137606.968855:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 101 00000100:00100000:2.0:1783137606.968908:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974441728 00000100:00100000:2.0:1783137606.968912:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974441728 00000100:00100000:2.0:1783137606.968943:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974441344 00000100:00100000:2.0:1783137606.968946:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974441344 00000100:00100000:2.0:1783137606.968967:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:2.0:1783137606.968973:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2352:x1869754974441728:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137606.968998:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2352:x1869754974441728:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137606.969005:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 165 00000100:00100000:2.0:1783137606.969014:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00100000:2.0:1783137606.969019:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:2351:x1869754974441344:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:2.0:1783137606.969038:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:2351:x1869754974441344:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 18us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137606.969043:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 166 00000100:00080000:2.0:1783137606.969062:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783137606.969066:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137606.969068:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137606.969406:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974441216 00000100:00100000:0.0:1783137606.969411:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974441216 00000100:00100000:0.0:1783137606.969444:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 300 00000100:00100000:0.0:1783137606.969451:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974441216:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137606.969481:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974441216:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 31us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137606.969486:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 300 00010000:00010000:2.0:1783137607.147051:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137608.166951:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137609.191090:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137609.480513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137609.484172:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974441984 00000100:00100000:1.0:1783137609.484189:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974441984 00000100:00100000:1.0:1783137609.484282:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00100000:1.0:1783137609.484296:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+18:12324:x1869754974441984:12345-192.168.203.36@tcp:35:umount.0 00000100:00100000:1.0:1783137609.484954:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:12324:x1869754974441984:12345-192.168.203.36@tcp:35:umount.0 Request processed in 659us (4449us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1783137609.484962:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 66 00000100:00080000:2.0:1783137609.486398:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137609.490522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137609.493672:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974442240 00000100:00100000:1.0:1783137609.493685:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974442240 00000100:00100000:1.0:1783137609.493762:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:1.0:1783137609.493772:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+19:12324:x1869754974442240:12345-192.168.203.36@tcp:35:umount.0 00000100:00100000:1.0:1783137609.495251:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:12324:x1869754974442240:12345-192.168.203.36@tcp:35:umount.0 Request processed in 1471us (4728us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1783137609.495264:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 67 00000100:00100000:0.0:1783137609.504666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137609.504822:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974442496 00000100:00100000:3.0:1783137609.504832:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974442496 00000100:00100000:3.0:1783137609.504891:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:3.0:1783137609.504901:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709aa7b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+20:12324:x1869754974442496:12345-192.168.203.36@tcp:35:umount.0 00000100:00100000:3.0:1783137609.505381:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709aa7b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:12324:x1869754974442496:12345-192.168.203.36@tcp:35:umount.0 Request processed in 480us (733us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1783137609.505395:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 68 00000100:00100000:2.0:1783137609.509207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137609.510281:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974442752 00000100:00100000:3.0:1783137609.510292:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974442752 00000100:00100000:3.0:1783137609.510951:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:3.0:1783137609.510964:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:12324:x1869754974442752:12345-192.168.203.36@tcp:35:umount.0 00000100:00100000:3.0:1783137609.511305:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+22:12324:x1869754974442752:12345-192.168.203.36@tcp:35:umount.0 Request processed in 344us (2107us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1783137609.511313:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 69 00000100:00100000:0.0:1783137609.523004:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137609.523053:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137609.523155:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137609.523208:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974442880 00000100:00100000:2.0:1783137609.523218:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974442880 00000100:00100000:2.0:1783137609.523286:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 72 00000100:00100000:2.0:1783137609.523295:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2350:x1869754974442880:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:2.0:1783137609.523323:0:6619:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674c84 00000100:00080000:2.0:1783137609.523331:0:6619:0:(import.c:65:import_set_state_nolock()) ffff9709b7994000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783137609.523378:0:6619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1783137609.523755:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+2:2350:x1869754974442880:12345-192.168.203.36@tcp:9:umount.0 Request processed in 458us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137609.523763:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 72 00010000:00010000:2.0:1783137609.523815:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137609.524188:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137609.528826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137609.532882:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974443136 00000100:00100000:1.0:1783137609.532897:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974443136 00000100:00100000:1.0:1783137609.533055:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974443008 00000100:00100000:1.0:1783137609.533059:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974443008 00000100:00100000:0.0:1783137609.533350:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974443264 00000100:00100000:0.0:1783137609.533355:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974443264 00000100:00100000:0.0:1783137609.533387:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:0.0:1783137609.533395:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+15:2352:x1869754974443136:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137609.533411:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137609.533430:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2045400/0x88def104ac674912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726b7 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137609.533446:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137609.533500:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+14:2352:x1869754974443136:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 104us (10445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137609.533508:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:0.0:1783137609.533524:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:0.0:1783137609.533530:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+13:2352:x1869754974443008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137609.533536:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137609.533545:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488600/0x88def104ac6749ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726ef expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137609.533555:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137609.533572:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+12:2352:x1869754974443008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 43us (10417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137609.533594:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:0.0:1783137609.533608:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1783137609.533613:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:2352:x1869754974443264:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137609.533621:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137609.533629:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd050000/0x88def104ac674b96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727ba expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137609.533639:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137609.533657:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2352:x1869754974443264:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 42us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137609.533663:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:3.0:1783137609.534059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137609.534202:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974443648 00000100:00100000:3.0:1783137609.534207:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974443648 00000100:00100000:3.0:1783137609.534245:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 73 00000100:00100000:3.0:1783137609.534252:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+7:2350:x1869754974443648:12345-192.168.203.36@tcp:9:umount.0 00000020:00000080:3.0:1783137609.534274:0:6618:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674ee5 00000020:00010000:3.0:1783137609.534280:0:6618:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97098534c000: total 0 00000100:00080000:3.0:1783137609.534285:0:6618:0:(import.c:65:import_set_state_nolock()) ffff97098534e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137609.534321:0:6618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1783137609.534560:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d717cef4-1367-4dd9-ae68-a0c1ee666834+5:2350:x1869754974443648:12345-192.168.203.36@tcp:9:umount.0 Request processed in 307us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137609.534568:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 73 00000020:00010000:3.0:1783137609.534585:0:5803:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97098534c000: total 0 00010000:00010000:3.0:1783137609.534606:0:5803:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97098534c000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783137609.534726:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3931a7/0x88def104ac675288 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7298f expref: 4 pid: 8200 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137609.534758:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8bb8f5c/0x88def104ac675926 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b5d expref: 3 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137609.534774:0:5803:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97098534c000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1783137609.534787:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137609.534814:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137609.534816:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137609.534824:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137609.548192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137609.548295:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974444672 00000100:00100000:2.0:1783137609.548304:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974444672 00000100:00100000:2.0:1783137609.548365:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 240 00000100:00100000:2.0:1783137609.548375:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+22:2350:x1869754974444672:12345-192.168.203.36@tcp:39:umount.0 00000020:00000080:2.0:1783137609.548408:0:5815:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674920 00000020:00010000:2.0:1783137609.548424:0:5815:0:(genops.c:1942:obd_stale_export_put()) Put export ffff970997f38800: total 0 00000100:00080000:2.0:1783137609.548429:0:5815:0:(import.c:65:import_set_state_nolock()) ffff970997f3e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783137609.548457:0:5815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1783137609.548878:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d717cef4-1367-4dd9-ae68-a0c1ee666834+21:2350:x1869754974444672:12345-192.168.203.36@tcp:39:umount.0 Request processed in 503us (693us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1783137609.548887:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 240 00000020:00010000:1.0:1783137609.549442:0:5802:0:(genops.c:1928:obd_stale_export_get()) Get export ffff970997f38800: total 0 00010000:00010000:1.0:1783137609.549488:0:5802:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff970997f38800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783137609.549518:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:1.0:1783137609.549521:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783137609.549531:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac674c5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727e4 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.549569:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9709860f4300) 00010000:00010000:1.0:1783137609.549572:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137609.549576:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051800/0x88def104ac674f47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec728b6 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.549593:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff970987960d00) 00010000:00010000:1.0:1783137609.549596:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137609.549600:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005000/0x88def104ac674bea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727c8 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.549615:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:1.0:1783137609.549617:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783137609.549620:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051e00/0x88def104ac675306 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729b2 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.549631:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff970990e98000) 00010000:00010000:1.0:1783137609.549634:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137609.549637:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d600/0x88def104ac6755e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72a84 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.550602:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137609.550605:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137609.550614:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b10 expref: 15 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.550626:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:1.0:1783137609.550629:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137609.550646:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004600/0x88def104ac675169 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72942 expref: 14 pid: 7113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.550661:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff970990e98300) 00010000:00010000:1.0:1783137609.550664:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137609.550667:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050800/0x88def104ac674c06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727cf expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.550682:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137609.550684:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137609.550688:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235c00/0x88def104ac6758e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b48 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.550701:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98500) 00010000:00010000:1.0:1783137609.550716:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137609.550721:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd050400/0x88def104ac6752ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec729ab expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.550734:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff970987960100) 00010000:00010000:1.0:1783137609.550737:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783137609.550740:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675911 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b56 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.550754:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:1.0:1783137609.550757:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783137609.550760:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd005e00/0x88def104ac675249 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7297a expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.550772:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff970990e98200) 00010000:00010000:1.0:1783137609.550782:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783137609.550787:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd051c00/0x88def104ac675273 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72988 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137609.550832:0:5802:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff970997f38800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1783137609.550869:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137609.550872:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137609.550874:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137609.639453:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd0a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990150784:0@lo:400:kworker.0 00000100:00100000:0.0:1783137609.639526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137609.639648:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990150784 00000100:00100000:2.0:1783137609.639657:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990150784 00000100:00100000:2.0:1783137609.639705:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1783137609.639715:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.640994:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990151168:0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.641081:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137609.641158:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990151168 00000100:00100000:3.0:1783137609.641164:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990151168 00000100:00100000:3.0:1783137609.641225:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783137609.641234:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990151168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.641292:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990151168:12345-0@lo:400:kworker.0 Request processed in 59us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137609.641300:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1783137609.641324:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137609.641353:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990151168:0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.641398:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990150912:0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.641427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137609.641452:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137609.641464:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990151040:0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.641486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137609.641511:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990150912 00000100:00100000:3.0:1783137609.641521:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990150912 00000100:00100000:3.0:1783137609.641546:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990151040 00000100:00100000:3.0:1783137609.641548:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990151040 00000100:00100000:3.0:1783137609.641569:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783137609.641713:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.641759:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990150912:12345-0@lo:400:kworker.0 Request processed in 49us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137609.641765:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783137609.641779:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783137609.641785:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990151040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.641843:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990151040:12345-0@lo:400:kworker.0 Request processed in 58us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137609.641873:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1783137609.641896:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137609.641914:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990151040:0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.641925:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990150912:0@lo:400:kworker.0 00000100:00100000:2.0:1783137609.648780:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3309:x1869754990150784:12345-0@lo:400:kworker.0 Request processed in 9056us (9242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137609.648815:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1783137609.650220:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd0a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73e4795b-54a4-4490-bb2a-864b21234c99:3309:1869754990150784:0@lo:400:kworker.0 00000100:00100000:2.0:1783137609.651635:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990151424:0@lo:400:kworker.0 00000100:00100000:2.0:1783137609.651717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137609.651950:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990151424 00000100:00100000:1.0:1783137609.651963:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990151424 00000100:00100000:1.0:1783137609.653166:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783137609.653186:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990151424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.653749:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137609.653770:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990151296:0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.653832:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137609.653899:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990151296 00000100:00100000:3.0:1783137609.653906:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990151296 00000100:00100000:3.0:1783137609.653947:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783137609.653954:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990151296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137609.653990:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990151296:12345-0@lo:400:kworker.0 Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137609.653997:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783137609.654038:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990151296:0@lo:400:kworker.0 00000100:00080000:3.0:1783137609.654088:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137609.654092:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137609.660727:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990151424:12345-0@lo:400:kworker.0 Request processed in 7540us (9000us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137609.660740:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783137609.666755:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990151424:0@lo:400:kworker.0 00000100:00100000:1.0:1783137610.151255:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990151552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137610.151340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137610.151456:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990151552 00000100:00100000:3.0:1783137610.151464:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990151552 00000100:00100000:3.0:1783137610.151513:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783137610.151521:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990151552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137610.151552:0:6623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137610.156654:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990151552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5125us (5306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137610.156667:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783137610.160736:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990151552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137610.215677:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137610.663433:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990151680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137610.663500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137610.664139:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990151680 00000100:00100000:2.0:1783137610.664148:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990151680 00000100:00100000:2.0:1783137610.664201:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783137610.664217:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990151680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137610.664253:0:6622:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137610.664307:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990151680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137610.664315:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783137610.664505:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990151680:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783137610.727312:0:11579:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783137610.727322:0:11579:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783137610.727714:0:11579:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1783137610.727722:0:11579:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783137611.239531:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783137611.246565:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:0.0:1783137611.246583:0:7535:0:(genops.c:906:class_export_put()) final put ffff9709b7990000/d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:2.0:1783137611.246833:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7990000/d717cef4-1367-4dd9-ae68-a0c1ee666834 for lustre-OST0001 00000020:00000080:2.0:1783137611.246885:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7994000 for lustre-OST0001 00000100:00100000:0.0:1783137611.705894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137611.705980:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137611.706081:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974444800 00000100:00100000:2.0:1783137611.706091:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974444800 00000100:00100000:2.0:1783137611.706146:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974444928 00000100:00100000:2.0:1783137611.706149:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974444928 00000100:00100000:2.0:1783137611.706170:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:2.0:1783137611.706179:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+11:2352:x1869754974444800:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137611.706193:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137611.706210:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970980031400/0x88def104ac6749f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72704 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137611.706228:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137611.706290:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+10:2352:x1869754974444800:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 103us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137611.706314:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:2.0:1783137611.706331:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:2.0:1783137611.706337:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+9:2352:x1869754974444928:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137611.706344:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137611.706353:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970980031800/0x88def104ac6749f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec7272e expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137611.706362:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137611.706391:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:2352:x1869754974444928:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 53us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137611.706397:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:0.0:1783137611.708907:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137611.709405:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974445056 00000100:00100000:2.0:1783137611.709414:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974445056 00000100:00100000:2.0:1783137611.709470:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:2.0:1783137611.709479:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+8:2353:x1869754974445056:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137611.709494:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137611.709510:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd234400/0x88def104ac674b8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec727b3 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137611.709525:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137611.709581:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+7:2353:x1869754974445056:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 97us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137611.709589:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:3.0:1783137611.717114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137611.717222:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974445312 00000100:00100000:0.0:1783137611.717231:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974445312 00000100:00080000:3.0:1783137611.717439:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137611.718514:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 241 00000100:00100000:0.0:1783137611.718544:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd0a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+6:2350:x1869754974445312:12345-192.168.203.36@tcp:39:umount.0 00000020:00000080:0.0:1783137611.718583:0:5816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674a07 00000020:00010000:0.0:1783137611.718591:0:5816:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9709b7940800: total 0 00000100:00080000:0.0:1783137611.718661:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9709b7941000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783137611.718736:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1783137611.719258:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd0a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:635ac0b3-e465-4842-aece-61b6c0568a2a+5:2350:x1869754974445312:12345-192.168.203.36@tcp:39:umount.0 Request processed in 717us (2161us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1783137611.719268:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 241 00000020:00010000:1.0:1783137611.727265:0:5802:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9709b7940800: total 0 00010000:00010000:1.0:1783137611.727275:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137611.727333:0:5802:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9709b7940800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783137611.727368:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970990e98500) 00010000:00010000:1.0:1783137611.727373:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137611.727602:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd004800/0x88def104ac675934 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b64 expref: 4 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137611.727630:0:5802:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9709b7940800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783137611.727642:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137611.727656:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137611.727657:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137611.756686:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137611.756771:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974445568 00000100:00100000:2.0:1783137611.756780:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974445568 00000100:00100000:2.0:1783137611.756861:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 302 00000100:00100000:2.0:1783137611.756885:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+7:2350:x1869754974445568:12345-192.168.203.36@tcp:251:umount.0 00000020:00000080:2.0:1783137611.756928:0:5807:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6748fd 00000020:00010000:2.0:1783137611.756936:0:5807:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9709b78ee000: total 0 00000100:00080000:2.0:1783137611.756941:0:5807:0:(import.c:65:import_set_state_nolock()) ffff9709b78eb000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783137611.757059:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970987337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab947cb7-67e1-4bdb-9ed6-c2a2167bac32+3:2350:x1869754974445568:12345-192.168.203.36@tcp:251:umount.0 Request processed in 176us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137611.757076:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 302 00000020:00010000:0.0:1783137611.757236:0:11060:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9709b78ee000: total 0 00010000:00010000:0.0:1783137611.757292:0:11060:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9709b78ee000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783137611.757325:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970980030000/0x88def104ac6749b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec726f6 expref: 2 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137611.757348:0:11060:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9709b78ee000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783137611.757359:0:11060:0:(genops.c:906:class_export_put()) final put ffff9709b78ee000/ab947cb7-67e1-4bdb-9ed6-c2a2167bac32 00010000:00010000:0.0:1783137611.757375:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137611.757384:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137611.757386:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783137611.757709:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b78ee000/ab947cb7-67e1-4bdb-9ed6-c2a2167bac32 for MGS 00000020:00000080:2.0:1783137611.757747:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b78eb000 for MGS 00010000:00010000:3.0:1783137612.265244:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783137612.808198:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 635ac0b3-e465-4842-aece-61b6c0568a2a 00000001:00080000:1.0:1783137612.808216:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1783137612.808222:0:5836:0:(genops.c:906:class_export_put()) final put ffff9709b7940800/635ac0b3-e465-4842-aece-61b6c0568a2a 00000001:00080000:1.0:1783137612.808240:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1783137612.808251:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000001:00080000:1.0:1783137612.808257:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1783137612.808266:0:5836:0:(genops.c:906:class_export_put()) final put ffff970997f38800/d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:3.0:1783137612.809079:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7940800/635ac0b3-e465-4842-aece-61b6c0568a2a for lustre-MDT0000 00000020:00000080:3.0:1783137612.809130:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff970997f38800/d717cef4-1367-4dd9-ae68-a0c1ee666834 for lustre-MDT0000 00000020:00000080:3.0:1783137612.809160:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7941000 for lustre-MDT0000 00000020:00000080:3.0:1783137612.809167:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff970997f3e000 for lustre-MDT0000 00000001:00100000:3.0:1783137612.821521:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:3.0:1783137612.821530:0:6644:0:(genops.c:906:class_export_put()) final put ffff97098534c000/d717cef4-1367-4dd9-ae68-a0c1ee666834 00000020:00000080:1.0:1783137612.821696:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff97098534c000/d717cef4-1367-4dd9-ae68-a0c1ee666834 for lustre-OST0000 00000020:00000080:1.0:1783137612.821758:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97098534e000 for lustre-OST0000 00010000:00010000:3.0:1783137613.287004:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783137613.958336:0:12913:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783137613.985199:0:12913:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783137613.985247:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.985262:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.985270:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.985296:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.985310:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783137613.985315:0:12913:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1783137613.985337:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137613.985342:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.985349:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0da00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137613.985351:0:11060:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.985360:0:11060:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137613.985367:0:11060:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137613.985372:0:11060:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783137613.985375:0:11060:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783137613.985378:0:11060:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783137613.985408:0:11060:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.985415:0:11060:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137613.985436:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.985443:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709afd0da00/0x88def104ac674982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674989 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.985459:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137613.985461:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137613.985463:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137613.985470:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137613.985486:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990151808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137613.985543:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137613.985601:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990151808 00000100:00100000:0.0:1783137613.985607:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990151808 00000100:00100000:0.0:1783137613.986405:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783137613.986417:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+19:3308:x1869754990151808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783137613.986433:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137613.986448:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981489000/0x88def104ac674989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674982 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.986460:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137613.986506:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73e4795b-54a4-4490-bb2a-864b21234c99+18:3308:x1869754990151808:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137613.986513:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783137613.990282:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990151808:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783137613.990332:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137613.990336:0:12913:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783137613.990342:0:12913:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783137613.990365:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9709bf1f9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783137613.990707:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990151936:0@lo:39:umount.0 00000100:00100000:1.0:1783137613.990766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137613.990900:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990151936 00000100:00100000:3.0:1783137613.990907:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990151936 00000100:00100000:3.0:1783137613.990944:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783137613.990952:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869754990151936:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783137613.990974:0:5814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac67471a 00000100:00080000:3.0:1783137613.990980:0:5814:0:(import.c:65:import_set_state_nolock()) ffff9709886ea000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783137613.991170:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1869754990151936:12345-0@lo:39:umount.0 Request processed in 218us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137613.991177:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1783137613.991187:0:5814:0:(genops.c:906:class_export_put()) final put ffff9709886ed000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1783137613.991226:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783137613.991233:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709886ed000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783137613.991270:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709886ea000 for lustre-MDT0000 00000100:00080000:1.0:1783137613.991334:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709bf1f9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783137613.991343:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990151936:0@lo:39:umount.0 00000100:00080000:3.0:1783137613.991556:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137613.991560:0:12913:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783137613.991564:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783137613.995871:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.995889:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.995896:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.995902:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.995919:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783137613.995924:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.995930:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.995936:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.995955:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.995977:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783137613.995984:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.995985:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137613.995991:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.995992:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.995998:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996000:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031000 already unused, calling callback (ffffffffc1af7c20) 00010000:00010000:2.0:1783137613.996004:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137613.996004:0:11060:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.996014:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783137613.996019:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.996026:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996029:0:11060:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.996032:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.996038:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137613.996048:0:11060:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137613.996053:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1783137613.996054:0:11060:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137613.996056:0:12913:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:0.0:1783137613.996057:0:11060:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1783137613.996059:0:11060:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000004:2.0:1783137613.996077:0:12913:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1783137613.996081:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1783137613.996084:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783137613.996088:0:12913:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00010000:00010000:0.0:1783137613.996090:0:11060:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783137613.996095:0:12913:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9709b1978000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1783137613.996095:0:11060:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1783137613.996100:0:12913:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9709b7c99000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783137613.996105:0:12913:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9709873d8000) has exports, disconnecting them 00000020:00080000:2.0:1783137613.996109:0:12913:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9709b1978000), last request at 1783137609 00000020:00000080:2.0:1783137613.996115:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac67487f 00010000:00010000:0.0:1783137613.996125:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783137613.996129:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9709b197a000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783137613.996132:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac674990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996144:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783137613.996147:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996152:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031c00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137613.996155:0:11060:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996162:0:11060:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783137613.996163:0:12913:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9709b1978000): rc 0 00000020:00000080:2.0:1783137613.996166:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709b1978000/lustre-MDT0000-lwp-OST0001_UUID 10000000:00010000:0.0:1783137613.996168:0:11060:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783137613.996173:0:12913:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9709b7c99000), last request at 1783137609 00000020:00000080:2.0:1783137613.996176:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6747a6 00000100:00080000:2.0:1783137613.996180:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9709b7c9d000 : changing import state from FULL to CLOSED 10000000:01000000:0.0:1783137613.996181:0:11060:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783137613.996184:0:11060:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00080000:2.0:1783137613.996185:0:12913:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9709b7c99000): rc 0 10000000:01000000:0.0:1783137613.996185:0:11060:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:2.0:1783137613.996187:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709b7c99000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1783137613.996195:0:12913:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8bdc1dbfae0 00010000:00010000:0.0:1783137613.996198:0:11060:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996203:0:11060:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137613.996209:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996215:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970980031c00/0x88def104ac6748b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac6748be expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783137613.996224:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783137613.996227:0:12913:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:0.0:1783137613.996227:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783137613.996230:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996234:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d400 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:0.0:1783137613.996237:0:11060:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783137613.996238:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1783137613.996244:0:11060:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137613.996249:0:11060:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137613.996254:0:11060:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783137613.996256:0:11060:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783137613.996257:0:11060:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783137613.996274:0:11060:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996280:0:11060:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137613.996290:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783137613.996297:0:12913:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:0.0:1783137613.996297:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709afd0d400/0x88def104ac674bb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674bc0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996305:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1783137613.996306:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9709886ee000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1783137613.996309:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996314:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2173e00 already unused, calling callback (ffffffffc1af7c20) 00000100:00080000:2.0:1783137613.996315:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783137613.996317:0:12913:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 10000000:00010000:0.0:1783137613.996317:0:11060:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996323:0:11060:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783137613.996329:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:00010000:0.0:1783137613.996329:0:11060:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137613.996334:0:11060:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783137613.996336:0:11060:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783137613.996337:0:11060:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783137613.996346:0:11060:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996352:0:11060:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783137613.996357:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996368:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2173e00/0x88def104ac67466b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac674672 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996384:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137613.996386:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137613.996388:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137613.996402:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990152064:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1783137613.996404:0:12913:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783137613.996413:0:12913:0:(import.c:65:import_set_state_nolock()) ffff9709b7994800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1783137613.996438:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9709873d8000) has no exports 00000100:00100000:0.0:1783137613.996460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137613.996502:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137613.996508:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990152192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137613.996531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137613.996565:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990152064 00000100:00100000:0.0:1783137613.996571:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990152064 00000100:00100000:0.0:1783137613.996605:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990152192 00000100:00100000:0.0:1783137613.996608:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990152192 00000100:00100000:0.0:1783137613.996630:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783137613.996637:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+19:3306:x1869754990152064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783137613.996648:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137613.996661:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709afd0c600/0x88def104ac674997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674990 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996672:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137613.996706:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+18:3306:x1869754990152064:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137613.996713:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783137613.996728:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137613.996734:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+17:3306:x1869754990152192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783137613.996748:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137613.996757:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2173c00/0x88def104ac6748be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac6748b7 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137613.996769:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137613.996813:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e4795b-54a4-4490-bb2a-864b21234c99+16:3306:x1869754990152192:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137613.996819:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137613.996858:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990152192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137613.996867:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990152064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137613.997195:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137613.997201:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137613.997211:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990152320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137613.997240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137613.997271:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137613.997277:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990152576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137613.997299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137613.997331:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990152320 00000100:00100000:3.0:1783137613.997335:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990152320 00000100:00100000:3.0:1783137613.997354:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990152576 00000100:00100000:3.0:1783137613.997357:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990152576 00000100:00100000:3.0:1783137613.997371:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783137613.997377:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+17:3308:x1869754990152320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137613.997384:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137613.997393:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709afd0ca00/0x88def104ac674bc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674bb9 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137613.997402:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137613.997427:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+16:3308:x1869754990152320:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137613.997434:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783137613.997447:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783137613.997453:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+15:3308:x1869754990152576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137613.997467:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137613.997475:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709c2044a00/0x88def104ac674672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac67466b expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137613.997486:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137613.997507:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73e4795b-54a4-4490-bb2a-864b21234c99+14:3308:x1869754990152576:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137613.997513:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783137613.997538:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990152576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137613.997547:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990152320:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1783137613.997981:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b1978000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783137613.998351:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c99000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783137613.998375:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b197a000 for lustre-MDT0000 00000020:00000080:1.0:1783137613.998379:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7c9d000 for lustre-MDT0000 00000100:00100000:1.0:1783137613.998395:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990152448:0@lo:9:umount.0 00000100:00100000:1.0:1783137613.998432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137613.998461:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990152704:0@lo:9:umount.0 00000100:00100000:1.0:1783137613.998478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137613.998730:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990152448 00000100:00100000:3.0:1783137613.998735:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990152448 00000100:00100000:3.0:1783137613.998779:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990152704 00000100:00100000:3.0:1783137613.998783:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990152704 00000100:00100000:3.0:1783137613.998830:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783137613.998838:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869754990152448:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783137613.998858:0:6619:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6747f3 00000100:00080000:3.0:1783137613.998865:0:6619:0:(import.c:65:import_set_state_nolock()) ffff9709b7c9d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137613.998894:0:6619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1783137613.999346:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1869754990152448:12345-0@lo:9:umount.0 Request processed in 508us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137613.999354:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783137613.999368:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783137613.999374:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869754990152704:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783137613.999384:0:6619:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6748e8 00000100:00080000:3.0:1783137613.999389:0:6619:0:(import.c:65:import_set_state_nolock()) ffff9709b78ee800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137613.999406:0:6619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1783137613.999582:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1869754990152704:12345-0@lo:9:umount.0 Request processed in 208us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137613.999589:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1783137613.999631:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137613.999637:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137613.999665:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709886ee000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783137613.999676:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783137613.999678:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783137613.999681:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990152448:0@lo:9:umount.0 00000100:00080000:3.0:1783137613.999692:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b7994800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783137613.999700:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783137613.999702:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783137613.999704:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990152704:0@lo:9:umount.0 00000100:00080000:1.0:1783137613.999978:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137613.999982:0:5810:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1783137614.028277:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9709873d8000) has no exports 00000020:00000080:2.0:1783137614.081995:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6746c6 00000020:00000080:2.0:1783137614.082009:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709b1f1c000/lustre-QMT0000_UUID 00000020:01000000:2.0:1783137614.082027:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783137614.082097:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b1f1c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783137614.084233:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137614.084245:0:12913:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783137614.084250:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9709bf1f3380) has no exports 00000020:00000080:3.0:1783137614.084748:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6746bf 00000020:00000080:3.0:1783137614.084756:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bf1fc000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783137614.084835:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bf1fc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783137614.084857:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137614.084865:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783137614.084868:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bf1f8000/lustre-QMT0000_UUID 00000020:00000080:3.0:1783137614.084870:0:12913:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bf1f8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783137614.084878:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1783137614.084999:0:12913:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97098b823300 - data ffff9709a5884948/ffff9709b79f1800 00000020:01000000:3.0:1783137614.085121:0:12913:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9709b1cdda80 - data ffff97099ddee6c0/ffff97098b681c00 00000001:00000004:3.0:1783137614.106259:0:12913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1783137614.232191:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783137614.232198:0:12913:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1783137614.232218:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783137614.232221:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783137614.233276:0:6666:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783137614.233282:0:6666:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1783137614.233292:0:6666:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783137614.234439:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783137614.234445:0:12913:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1783137614.234464:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783137614.234466:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783137614.235591:0:7886:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783137614.235596:0:7886:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1783137614.235607:0:7886:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1783137614.315648:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac67468e 00000020:00000080:3.0:1783137614.315662:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bd931000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783137614.315838:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd931000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783137614.319784:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6746a3 00000020:00000080:3.0:1783137614.319815:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bd937000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783137614.319839:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783137614.319848:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137614.319855:0:12913:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783137614.319859:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9709873dcd40) has no exports 00000020:00000080:2.0:1783137614.320372:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd937000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1783137614.323667:0:12913:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783137614.324655:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6748e1 00000020:00000080:3.0:1783137614.324666:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709b7c75800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783137614.324739:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783137614.324748:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137614.324758:0:12913:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783137614.324762:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9709bd93b380) has no exports 00000020:00000080:3.0:1783137614.324770:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6748da 00000020:00000080:3.0:1783137614.324774:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709b7991800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783137614.331215:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c75800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1783137614.338249:0:12913:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783137614.338257:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783137614.338261:0:12913:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1783137614.338268:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783137614.338270:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783137614.339975:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7991800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783137614.340529:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137614.340543:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783137614.340552:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6747ec 00000020:00000080:3.0:1783137614.340560:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bd934800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783137614.340680:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7994800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783137614.340696:0:5309:0:(genops.c:906:class_export_put()) final put ffff9709b7995800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783137614.340698:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7995800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783137614.340703:0:5309:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783137614.341210:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783137614.341217:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137614.341223:0:12913:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783137614.341227:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9709bf1f0000) has no exports 00000020:00000080:3.0:1783137614.341234:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6747e5 00000020:00000080:3.0:1783137614.341239:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bd933000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783137614.341318:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd934800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1783137614.341716:0:12913:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783137614.341720:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783137614.341744:0:12913:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1783137614.341749:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783137614.341752:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783137614.341783:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137614.341877:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd933000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783137614.341884:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709886ee000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783137614.342006:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783137614.342011:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709b37bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783137614.342014:0:12913:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b37bc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783137614.342021:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783137614.342159:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137614.342164:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783137614.342167:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709ab346800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783137614.342169:0:12913:0:(genops.c:865:class_export_destroy()) destroying export ffff9709ab346800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783137614.342172:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783137614.342412:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6746aa 00000020:00000080:3.0:1783137614.342469:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bd934000/lustre-MDD0000_UUID 00000020:01000000:3.0:1783137614.342485:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1783137614.342489:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137614.342494:0:12913:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783137614.342497:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9709bd93cd40) has no exports 00000020:00000080:3.0:1783137614.342514:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137614.342518:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1783137614.342521:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6746b1 00000020:00000080:3.0:1783137614.342525:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bd937800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783137614.342532:0:12913:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97099cc6e000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1783137614.342536:0:12913:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97099cc6e000 3 00000020:01000004:3.0:1783137614.342538:0:12913:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97099cc6e000 from lustre-MDT0000 00000020:00000080:3.0:1783137614.342554:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137614.342558:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1783137614.342560:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bd932800/lustre-MDT0000_UUID 00000020:00000080:3.0:1783137614.342563:0:12913:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd932800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1783137614.342569:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1783137614.342604:0:12913:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1783137614.342608:0:12913:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1783137614.342611:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1783137614.342614:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137614.342616:0:12913:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783137614.342622:0:12913:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff970987b50000 73e4795b-54a4-4490-bb2a-864b21234c99 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137614.342629:0:12913:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9709887419c0) has exports, disconnecting them 00000020:00080000:3.0:1783137614.342633:0:12913:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff970987b50000), last request at 1783137388 00000020:00000080:3.0:1783137614.342646:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac67464f 00000020:00010000:3.0:1783137614.342650:0:12913:0:(genops.c:1942:obd_stale_export_put()) Put export ffff970987b50000: total 2 00000100:00080000:3.0:1783137614.342654:0:12913:0:(import.c:65:import_set_state_nolock()) ffff970987b52000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783137614.342719:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd934000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783137614.342737:0:5309:0:(genops.c:906:class_export_put()) final put ffff9709bd932000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783137614.342740:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd932000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783137614.342743:0:5309:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783137614.342936:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd937800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1783137614.343133:0:12913:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff970987b50000): rc 0 00000020:00080000:3.0:1783137614.343138:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9709887419c0) has no exports 00000100:00100000:3.0:1783137614.343192:0:5808:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97098b3c6000:5808] 1 exiting: rc = 0 00000100:00100000:3.0:1783137614.345421:0:5807:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97098b3c7400:5807] 0 exiting: rc = 1 00000100:00100000:1.0:1783137614.345847:0:5809:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97098b3c7800:5809] 2 exiting: rc = 0 00000020:00010000:2.0:1783137614.345956:0:5803:0:(genops.c:1928:obd_stale_export_get()) Get export ffff970987b50000: total 0 00010000:00010000:2.0:1783137614.346001:0:5803:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff970987b50000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1783137614.346131:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd050a00/0x88def104ac67495f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674958 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137614.346153:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981489600/0x88def104ac674951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac67494a expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137614.346183:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd050c00/0x88def104ac67497b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674974 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137614.346193:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488e00/0x88def104ac67496d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674966 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137614.346274:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd051a00/0x88def104ac674ba4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674b9d expref: 5 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137614.346285:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981488800/0x88def104ac6749a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac67499e expref: 4 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137614.346297:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970981489a00/0x88def104ac674759 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674752 expref: 3 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137614.346307:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709afd0c400/0x88def104ac674bb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88def104ac674bab expref: 2 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137614.346317:0:5803:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff970987b50000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1783137614.346331:0:5803:0:(genops.c:906:class_export_put()) final put ffff970987b50000/73e4795b-54a4-4490-bb2a-864b21234c99 00010000:00010000:2.0:1783137614.346346:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137614.346348:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137614.346349:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783137614.346359:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff970987b50000/73e4795b-54a4-4490-bb2a-864b21234c99 for MGS 00000020:00000080:2.0:1783137614.346390:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff970987b52000 for MGS 00000100:00100000:3.0:1783137614.346503:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346512:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346518:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346525:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346530:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346536:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346542:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346549:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346555:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346560:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346566:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346571:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346577:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346582:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346587:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346593:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346599:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346604:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346618:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346624:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346629:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346635:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346641:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346647:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346653:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346658:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346663:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346670:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346675:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346681:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346686:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346690:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346695:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346702:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346708:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346713:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346718:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346736:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346743:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346748:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346754:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346760:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346766:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346772:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346777:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346782:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346787:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346818:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346833:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346838:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346842:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346847:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346851:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346863:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346869:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346874:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346880:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346886:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346891:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346896:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346901:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346906:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346912:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.346917:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1783137614.347582:0:12913:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783137614.347586:0:12913:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1783137614.351449:0:12913:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97098a25ab40 - data ffff9709a5851a20/ffff9709bd016000 00000020:01000000:3.0:1783137614.351564:0:12913:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97098b0c1ea0 - data ffff97099df5d870/ffff9709897f7c00 00000020:00000080:3.0:1783137614.353499:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674633 00000020:00000080:3.0:1783137614.353510:0:12913:0:(genops.c:906:class_export_put()) final put ffff970992529800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783137614.353530:0:12913:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97099cc6e000 from MGS, refs=2 00000020:01000004:3.0:1783137614.353533:0:12913:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97099cc6e000 2 00000020:01000004:3.0:1783137614.353536:0:12913:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97099cc6e000 from MGS 00000020:00000080:3.0:1783137614.353559:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137614.353567:0:12913:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783137614.353569:0:12913:0:(genops.c:906:class_export_put()) final put ffff97099cc6f000/MGS 00000020:00000080:3.0:1783137614.353572:0:12913:0:(genops.c:865:class_export_destroy()) destroying export ffff97099cc6f000/MGS for MGS 00000020:01000000:3.0:1783137614.353578:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1783137614.353637:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783137614.353641:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137614.353646:0:12913:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783137614.353652:0:12913:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9709bf1ff800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137614.353658:0:12913:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9709bf1f19c0) has exports, disconnecting them 00000020:00080000:3.0:1783137614.353662:0:12913:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9709bf1ff800), last request at 1783137391 00000020:00000080:3.0:1783137614.353667:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac6746fe 00000020:00080000:3.0:1783137614.353699:0:12913:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9709bf1ff800): rc 0 00000020:00000080:3.0:1783137614.353704:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bf1ff800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783137614.354986:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff970992529800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783137614.354999:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bf1ff800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783137614.358005:0:12913:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783137614.358013:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783137614.358027:0:12913:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783137614.358174:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783137614.358249:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709bf1f9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783137614.359141:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137614.359156:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1783137614.359163:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709bf1ff000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783137614.359168:0:12913:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bf1ff000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783137614.359174:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783137614.359479:0:12913:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97099cc6e000 1 00000020:00000080:2.0:1783137614.359485:0:12913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674625 00000020:00000080:2.0:1783137614.359491:0:12913:0:(genops.c:906:class_export_put()) final put ffff97099cc6a000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1783137614.359505:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783137614.359509:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783137614.359513:0:12913:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783137614.359516:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff970988743380) has no exports 00000020:00000080:1.0:1783137614.359569:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff97099cc6a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783137614.474302:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137614.474514:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783137614.474521:0:12913:0:(genops.c:906:class_export_put()) final put ffff97099cc6d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783137614.474526:0:12913:0:(genops.c:865:class_export_destroy()) destroying export ffff97099cc6d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783137614.474533:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783137614.474695:0:12913:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff97099cc6c800 00000020:01000000:1.0:1783137614.474713:0:12913:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1783137614.474717:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783137614.474720:0:12913:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783137614.474724:0:12913:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9709873d99c0) has no exports 00000100:00100000:0.0:1783137614.475354:0:5816:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff97098667a400:5816] 2 exiting: rc = 0 00000100:00100000:3.0:1783137614.478655:0:5815:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff970986669400:5815] 1 exiting: rc = 0 00000100:00100000:3.0:1783137614.478779:0:5814:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff97098667ae00:5814] 0 exiting: rc = 1 00000100:00100000:3.0:1783137614.478877:0:7113:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff970997f1b400:7113] 3 exiting: rc = 0 00000100:00100000:2.0:1783137614.479265:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479273:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479279:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479286:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479292:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479297:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479303:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479308:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479313:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479319:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479325:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479332:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479337:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479344:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479349:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479355:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479360:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479365:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479371:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479394:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479400:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479406:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479411:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479416:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479421:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479427:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479432:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479438:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479444:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479449:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479454:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479458:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479464:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479469:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479474:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479479:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479484:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479488:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479493:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479498:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479503:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479508:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479512:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479517:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479521:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479526:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479531:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479537:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479542:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479547:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479552:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479557:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479562:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479567:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479579:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479584:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479590:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479594:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479599:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479605:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479610:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479617:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479622:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.479628:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.486512:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff970986668c00:5817] 0 exiting: rc = 1 00000100:00100000:3.0:1783137614.486775:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff970986668400:5818] 1 exiting: rc = 0 00000100:00100000:2.0:1783137614.487549:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487559:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487566:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487572:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487578:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487583:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487589:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487595:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487601:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487606:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487611:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487617:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487624:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487630:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487635:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487640:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487645:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487651:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487656:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487661:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487666:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487671:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487676:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487682:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487687:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487706:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487711:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487716:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487721:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487726:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487731:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487736:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487742:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487747:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487752:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487757:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487762:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487767:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487772:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487777:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487783:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487787:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487828:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487835:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487840:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487845:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487850:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487855:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487860:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487865:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487870:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487876:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487881:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487887:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487892:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487897:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487902:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487907:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487913:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487918:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487930:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487935:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487940:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.487945:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.488869:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff97098667a800:5819] 0 exiting: rc = 1 00000100:00100000:1.0:1783137614.489302:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff97098667aa00:5820] 1 exiting: rc = 0 00000100:00100000:1.0:1783137614.489762:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489768:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489774:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489910:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489920:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489926:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489932:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489938:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489955:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489961:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489967:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489972:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489978:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489984:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489990:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.489996:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490002:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490007:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490022:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490029:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490048:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490055:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490062:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490079:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490084:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490090:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490096:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490101:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490107:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490113:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490118:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490124:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490143:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490150:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490155:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490161:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490167:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490172:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490185:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490191:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490197:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490202:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490208:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490224:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490244:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490251:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490256:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490262:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490267:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490273:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490278:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490284:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490290:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490296:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490301:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490306:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490325:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490331:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490339:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490345:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490351:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490357:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490362:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.490368:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.501912:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9709897a5000:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1783137614.502734:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff970986679200:5822] 1 exiting: rc = 0 00000100:00100000:1.0:1783137614.502975:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.502983:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.502989:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.502994:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503000:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503006:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503012:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503145:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503149:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503168:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503173:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503178:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503183:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503188:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503193:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503199:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503203:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503208:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503284:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503289:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503294:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503299:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503304:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503308:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503313:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503318:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503323:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503328:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503333:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503338:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503343:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503348:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503353:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503358:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503364:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503369:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503376:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503381:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503386:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503391:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503396:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503401:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503406:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503411:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503423:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503427:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503432:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503437:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503442:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503446:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503451:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503456:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503461:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503466:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503471:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503475:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503480:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503485:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503490:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503494:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503499:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503505:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503510:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.503516:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.504687:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff970986678c00:5823] 0 exiting: rc = 1 00000100:00100000:2.0:1783137614.505136:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff970986678400:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1783137614.505568:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505575:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505650:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505655:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505660:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505665:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505671:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505676:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505682:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505687:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505692:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505696:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505701:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505705:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505710:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505725:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505730:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505735:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505741:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505745:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505751:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505756:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505762:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505766:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505771:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505776:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505781:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505785:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505931:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505939:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505944:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505949:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505953:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505957:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505962:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505966:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505971:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505976:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505981:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505986:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505991:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.505996:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506001:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506005:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506009:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506023:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506029:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506034:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506039:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506044:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506057:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506061:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506192:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506198:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506204:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506209:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506283:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506289:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506294:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506298:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506303:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506308:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506313:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.506317:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137614.506995:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff970986679000:5825] 0 exiting: rc = 1 00000100:00100000:2.0:1783137614.511690:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff970986678800:5826] 1 exiting: rc = 0 00000100:00100000:1.0:1783137614.512196:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512207:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512216:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512224:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512232:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512238:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512243:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512248:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512252:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512257:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512262:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512266:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512271:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512275:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512280:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512284:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512289:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512293:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512297:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512302:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512306:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512323:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512328:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512333:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512338:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512343:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512348:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512353:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512358:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512363:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512369:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512374:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512379:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512384:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512390:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512395:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512399:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512404:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512410:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512414:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512419:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512424:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512428:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512433:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512438:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512443:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512448:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512455:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512460:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512467:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512474:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512480:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512487:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512496:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512504:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512511:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512526:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512533:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512540:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512547:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512551:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512556:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512560:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137614.512565:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783137614.514193:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff970986679400:5829] 2 exiting: rc = 0 00000100:00100000:3.0:1783137614.517313:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff970986679800:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1783137614.520475:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff970986678000:5828] 1 exiting: rc = 0 00000100:00100000:2.0:1783137614.520991:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521001:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521009:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521027:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521035:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521042:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521050:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521057:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521141:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521154:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521176:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521208:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521229:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521238:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521246:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521255:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521262:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521271:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521280:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521287:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521295:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521302:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521310:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521316:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521335:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521342:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521350:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521361:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521371:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521380:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521387:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521392:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521397:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521402:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521407:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521414:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521450:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521457:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521491:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521500:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521507:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521515:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521522:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521530:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521538:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521546:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521553:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521560:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521568:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521638:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521648:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521653:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521660:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521666:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521678:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521720:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521727:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521735:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521743:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521760:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521767:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521775:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521782:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137614.521985:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783137614.537961:0:12913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137614.538123:0:12913:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1783137614.538196:0:12913:0:(genops.c:906:class_export_put()) final put ffff9709ab343000/MDS_uuid 00000020:00000080:2.0:1783137614.538209:0:12913:0:(genops.c:865:class_export_destroy()) destroying export ffff9709ab343000/MDS_uuid for MDS 00000020:01000000:2.0:1783137614.538215:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1783137614.538584:0:12913:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1783137614.576042:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137614.763067:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990152832:0@lo:400:kworker.0 00000400:00000100:2.0:1783137614.763120:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869754990152832 offset 0 length 224: 4 00000100:00100000:2.0:1783137614.763181:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137614.763187:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990152960:0@lo:400:kworker.0 00000400:00000100:2.0:1783137614.763206:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869754990152960 offset 0 length 224: 4 00000100:00100000:2.0:1783137614.763228:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990153088:0@lo:400:kworker.0 00000400:00000100:2.0:1783137614.763244:0:3308:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869754990153088 offset 0 length 224: 4 00010000:00010000:3.0:1783137615.593204:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783137616.402419:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783137616.402428:0:7535:0:(genops.c:906:class_export_put()) final put ffff9709b78ef000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783137616.402453:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b78ef000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783137616.402488:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b78ee800 for lustre-OST0001 00010000:00010000:2.0:1783137616.617475:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783137617.621188:0:13064:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783137617.636963:0:13064:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783137617.637010:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137617.637026:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137617.637033:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137617.637041:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137617.637067:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783137617.637085:0:13064:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783137617.637106:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783137617.637117:0:13064:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bd246300 x1869754990152960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137617.637130:0:13064:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783137617.637135:0:13064:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783137617.637159:0:13064:0:(import.c:65:import_set_state_nolock()) ffff9709b7c9f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783137617.637213:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137617.637219:0:11060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137617.637228:0:11060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0dc00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137617.637232:0:11060:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137617.637246:0:11060:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137617.637253:0:11060:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137617.637258:0:11060:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137617.637261:0:11060:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783137617.637264:0:11060:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783137617.637286:0:11060:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137617.637292:0:11060:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137617.637315:0:11060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137617.637322:0:11060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709afd0dc00/0x88def104ac674966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x88def104ac67496d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137617.637332:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137617.637334:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137617.637336:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137617.637358:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990152960:0@lo:400:kworker.0 00000100:00100000:2.0:1783137617.637387:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137617.637399:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990153344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137617.637454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137617.637508:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990153344 00000100:00100000:2.0:1783137617.637515:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990153344 00000100:00100000:2.0:1783137617.637561:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783137617.637574:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709886d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1869754990153344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783137617.637581:0:5801:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783137617 with bad export cookie 9862585236362577487 00000100:00100000:2.0:1783137617.647571:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709886d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1869754990153344:12345-0@lo:103:ldlm_bl.0 Request processed in 9988us (10108us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783137617.647585:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1783137617.647932:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.136@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783137617.647937:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9709ab342800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783137617.647940:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1783137617.652954:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1869754990153216:0@lo:39:umount.0 00000400:00000100:3.0:1783137617.653012:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869754990153216 offset 0 length 224: 4 00010000:00010000:3.0:1783137617.653069:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783137617.663641:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.136@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783137617.663648:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783137617.663657:0:3308:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bd247480 x1869754990152832/t0(0) o400->MGC192.168.203.136@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783137630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137617.663826:0:3308:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bd245c00 x1869754990153344/t0(0) o103->MGC192.168.203.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783137633 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783137617.663837:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783137617.663839:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783137617.663840:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783137617.663843:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9709ab342800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783137617.663847:0:3308:0:(import.c:512:import_select_connection()) MGC192.168.203.136@tcp: connect to NID 0@lo last attempt 144 00000100:00080000:0.0:1783137617.663856:0:3308:0:(import.c:626:import_select_connection()) MGC192.168.203.136@tcp: import ffff9709ab342800 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:1.0:1783137617.664034:0:3308:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bd076d80 x1869754990153472/t0(0) o250->MGC192.168.203.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783137617.664072:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73e4795b-54a4-4490-bb2a-864b21234c99:3308:1869754990153344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137617.664138:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e4795b-54a4-4490-bb2a-864b21234c99:3305:1869754990153472:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1783137617.664185:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869754990153472 offset 0 length 520: 4 00000100:00100000:2.0:1783137617.665525:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73e4795b-54a4-4490-bb2a-864b21234c99:3306:1869754990152832:0@lo:400:kworker.0 00000001:00100000:2.0:1783137617.946762:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783137617.946772:0:6644:0:(genops.c:906:class_export_put()) final put ffff9709b7c9c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783137617.946925:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c9c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783137617.947106:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7c9d800 for lustre-OST0000 00010000:00010000:2.0:1783137618.663014:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137619.693313:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137619.879186:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) 73e4795b-54a4-4490-bb2a-864b21234c99->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783137619.879196:0:5309:0:(pinger.c:249:ptlrpc_pinger_process_import()) 73e4795b-54a4-4490-bb2a-864b21234c99->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783137619.879295:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137619.879316:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990153600:0@lo:400:kworker.0 00000400:00000100:3.0:1783137619.879370:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869754990153600 offset 0 length 224: 4 00010000:00010000:3.0:1783137620.711266:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137621.736824:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137622.758990:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137622.886906:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) 73e4795b-54a4-4490-bb2a-864b21234c99->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783137622.886932:0:5309:0:(pinger.c:249:ptlrpc_pinger_process_import()) 73e4795b-54a4-4490-bb2a-864b21234c99->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783137622.887099:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783137622.887118:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990153728:0@lo:400:kworker.0 00000400:00000100:1.0:1783137622.887168:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869754990153728 offset 0 length 224: 4 00010000:00010000:3.0:1783137623.783635:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137624.811110:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137625.833013:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137626.855034:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137627.047001:0:3305:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783137617/real 1783137617] req@ffff9709bd076d80 x1869754990153472/t0(0) o250->MGC192.168.203.136@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783137627 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137627.047035:0:3305:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9709bd076d80 x1869754990153472/t0(0) o250->MGC192.168.203.136@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783137627 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137627.047047:0:3305:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783137617/real 1783137617] req@ffff9709bc35ce00 x1869754990153216/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783137627 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137627.047079:0:3305:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9709bc35ce00 x1869754990153216/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783137627 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783137627.047095:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709ab342800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783137627.047125:0:3305:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783137627.047130:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e4795b-54a4-4490-bb2a-864b21234c99:3305:1869754990153472:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1783137627.047136:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b7c9f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783137627.047173:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) 73e4795b-54a4-4490-bb2a-864b21234c99->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783137627.047188:0:5309:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783137627.047192:0:5309:0:(import.c:65:import_set_state_nolock()) ffff9709ab342800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137627.047198:0:5309:0:(import.c:512:import_select_connection()) MGC192.168.203.136@tcp: connect to NID 0@lo last attempt 373 00000100:00080000:3.0:1783137627.047204:0:5309:0:(import.c:591:import_select_connection()) MGC192.168.203.136@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783137627.047213:0:5309:0:(import.c:626:import_select_connection()) MGC192.168.203.136@tcp: import ffff9709ab342800 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:0.0:1783137627.047213:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1869754990153216:0@lo:39:umount.0 00000100:00100000:3.0:1783137627.047247:0:5309:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bca7c380 x1869754990153856/t0(0) o250->MGC192.168.203.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783137627.047311:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137627.047322:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990153984:0@lo:400:kworker.0 00000400:00000100:3.0:1783137627.047365:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869754990153984 offset 0 length 224: 4 00000100:00100000:0.0:1783137627.048652:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e4795b-54a4-4490-bb2a-864b21234c99:3305:1869754990153856:0@lo:250:kworker.0 00000400:00000100:0.0:1783137627.048691:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869754990153856 offset 0 length 520: 4 00000100:00080000:1.0:1783137627.049660:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783137627.049667:0:13064:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783137627.049673:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783137627.051959:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137627.051978:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137627.051986:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137627.051994:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137627.052084:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137627.052105:0:13064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137627.052485:0:13064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137627.052493:0:13064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137627.052499:0:13064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137627.055002:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137627.055015:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137627.055026:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031a00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137627.055030:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137627.055040:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137627.055048:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137627.055054:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137627.055074:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1783137627.055087:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9709ab342800 00010000:00010000:2.0:1783137627.055090:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137627.055098:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970980031a00/0x88def104ac674974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac67497b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137627.055124:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137627.055128:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137627.055133:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234800 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137627.055135:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137627.055142:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137627.055147:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137627.055152:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783137627.055154:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1783137627.055158:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9709ab342800 00010000:00010000:2.0:1783137627.055160:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137627.055174:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137627.055176:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137627.055178:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137627.055720:0:13064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783137627.055736:0:13064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd234800/0x88def104ac674bab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac674bb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137627.055748:0:13064:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1783137627.055753:0:13064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1783137627.055755:0:13064:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783137627.055782:0:13064:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783137627.055786:0:13064:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1783137627.055818:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783137627.055824:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783137627.055828:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff970988744d40) has no exports 00000020:00080000:1.0:1783137627.055853:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff970988744d40) has no exports 00010000:00010000:2.0:1783137627.058718:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783137627.060093:0:13064:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff970989a99600 - data ffff9709a588ad80/ffff9709bcb2c800 00000020:01000000:1.0:1783137627.060234:0:13064:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff970985172420 - data ffff9709a584d510/ffff9709afd2d800 00100000:10000000:1.0:1783137627.068838:0:13064:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783137627.120893:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674775 00000020:00000080:3.0:1783137627.120903:0:13064:0:(genops.c:906:class_export_put()) final put ffff9709b37b1800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1783137627.120920:0:13064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9709886eb800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1783137627.120923:0:13064:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9709886eb800 2 00000020:01000004:3.0:1783137627.120926:0:13064:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9709886eb800 from lustre-OST0000 00000020:00000080:3.0:1783137627.120951:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137627.120960:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1783137627.120964:0:13064:0:(genops.c:906:class_export_put()) final put ffff9709b37b3800/lustre-OST0000_UUID 00000020:00000080:3.0:1783137627.120967:0:13064:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b37b3800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1783137627.120973:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1783137627.121011:0:13064:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1783137627.121014:0:13064:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783137627.121018:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137627.121022:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783137627.121039:0:13064:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9709b7c9a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137627.121045:0:13064:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff970988740000) has exports, disconnecting them 00000020:00080000:3.0:1783137627.121050:0:13064:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9709b7c9a800), last request at 1783137414 00000020:00000080:3.0:1783137627.121054:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac67479f 00000020:00080000:3.0:1783137627.121063:0:13064:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9709b7c9a800): rc 0 00000020:00000080:3.0:1783137627.121068:0:13064:0:(genops.c:906:class_export_put()) final put ffff9709b7c9a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783137627.122133:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b37b1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783137627.122147:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c9a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783137627.124433:0:13064:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783137627.124441:0:13064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783137627.124446:0:13064:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783137627.124452:0:13064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783137627.124620:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137627.124629:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1783137627.124637:0:13064:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9709886eb800 1 00000020:00000080:2.0:1783137627.124642:0:13064:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac67472f 00000020:00000080:2.0:1783137627.124650:0:13064:0:(genops.c:906:class_export_put()) final put ffff9709bd18b000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783137627.124655:0:13064:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1783137627.124661:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783137627.124664:0:13064:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783137627.124667:0:13064:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9709bf1f4d40) has no exports 00000020:00000080:0.0:1783137627.125275:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b7c9f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783137627.125283:0:5309:0:(genops.c:906:class_export_put()) final put ffff9709b7c81000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1783137627.125286:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c81000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1783137627.125291:0:5309:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1783137627.125351:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd18b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783137627.143576:0:13064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783137627.143591:0:13064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1783137627.143598:0:13064:0:(genops.c:906:class_export_put()) final put ffff9709886e8800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1783137627.143602:0:13064:0:(genops.c:865:class_export_destroy()) destroying export ffff9709886e8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1783137627.143609:0:13064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1783137627.143742:0:13064:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9709886ed800 00000020:02000400:2.0:1783137627.143785:0:13064:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1783137627.879566:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137628.902939:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137629.928019:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1783137630.128490:0:3308:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783137614/real 1783137614] req@ffff9709bd245880 x1869754990153088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783137630 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137630.172632:0:3308:0:(client.c:2533:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9709bd245880 x1869754990153088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783137630 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783137630.172655:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9709b197b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783137630.172659:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783137630.185336:0:3308:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1783137630.185384:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 73e4795b-54a4-4490-bb2a-864b21234c99->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783137630.185390:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 73e4795b-54a4-4490-bb2a-864b21234c99->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783137630.185392:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783137630.185395:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783137630.185398:0:36:0:(import.c:65:import_set_state_nolock()) ffff9709b197b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137630.185406:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 189 00000100:00080000:3.0:1783137630.185415:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9709b197b800 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137630.185448:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bca7dc00 x1869754990154112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783137630.185466:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990153088:0@lo:400:kworker.0 00000100:00100000:3.0:1783137630.185483:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1869754990154112:0@lo:38:kworker.0 00000400:00000100:3.0:1783137630.185549:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869754990154112 offset 0 length 520: 4 00000020:01000004:2.0:1783137630.510298:0:13218:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783137630.520047:0:13218:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783137630.520139:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.520154:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.520163:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.520171:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.520210:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783137630.520217:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783137630.520239:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783137630.520250:0:13218:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bca7ed80 x1869754990153600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137635 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137630.520265:0:13218:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bca7df80 x1869754990153728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137638 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137630.520287:0:13218:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bca7d180 x1869754990153984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137643 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137630.520303:0:13218:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bca7dc00 x1869754990154112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783137640 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137630.520317:0:13218:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1783137630.520348:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990153984:0@lo:400:kworker.0 00000100:00080000:0.0:1783137630.520380:0:13218:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783137630.520386:0:13218:0:(import.c:65:import_set_state_nolock()) ffff9709b197b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783137630.520391:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783137630.520395:0:13218:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bca7ed80 x1869754990153600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137635 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137630.520417:0:13218:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bca7df80 x1869754990153728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137638 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137630.520427:0:13218:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bca7dc00 x1869754990154112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783137640 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137630.520600:0:13218:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783137630.520607:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:0.0:1783137630.520645:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1869754990153728:0@lo:400:kworker.0 00010000:00010000:2.0:1783137630.520726:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137630.520733:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137630.520752:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980030600 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137630.520757:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137630.520767:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137630.520775:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137630.520781:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137630.520784:0:5802:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783137630.520787:0:5802:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783137630.520832:0:5802:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9709ab342800 00010000:00010000:2.0:1783137630.520837:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137630.520845:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970980030600/0x88def104ac67494a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac674951 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137630.520858:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137630.520861:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137630.520863:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137630.520883:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990153600:0@lo:400:kworker.0 00000100:00100000:2.0:1783137630.523774:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1869754990154112:0@lo:38:kworker.0 00010000:00010000:0.0:1783137630.525821:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.525835:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.525842:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.525848:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.525865:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783137630.525870:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.525875:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.525879:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.525885:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137630.525895:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783137630.525899:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:3.0:1783137630.526030:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783137630.526038:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137630.526047:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031e00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137630.526051:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137630.526061:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137630.526069:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137630.526074:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783137630.526077:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1783137630.526079:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1783137630.526092:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9709ab342800 00010000:00010000:3.0:1783137630.526097:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137630.526104:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff970980031e00/0x88def104ac674958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac67495f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137630.526118:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137630.526122:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137630.526128:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0de00 already unused, calling callback (ffffffffc1af7c20) 00010000:00010000:1.0:1783137630.526132:0:11060:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1783137630.526143:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137630.526151:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137630.526157:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137630.526163:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783137630.526166:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783137630.526168:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783137630.526174:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9709ab342800 00010000:00010000:3.0:1783137630.526178:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137630.526184:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709afd0de00/0x88def104ac674b9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac674ba4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783137630.526274:0:13218:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783137630.526278:0:13218:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783137630.526283:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783137630.526295:0:13218:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783137630.526300:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9709bd85cd40) has no exports 00010000:00010000:3.0:1783137630.526322:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783137630.526324:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9709bd85cd40) has no exports 00010000:00010000:3.0:1783137630.526327:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137630.526331:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783137630.539237:0:13218:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff970989a998a0 - data ffff9709a588abd0/ffff9709bcb2fc00 00000020:01000000:0.0:1783137630.539389:0:13218:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff970989b56cc0 - data ffff970990033e58/ffff9709bd744400 00100000:10000000:0.0:1783137630.556597:0:13218:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783137630.598537:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac67484e 00000020:00000080:3.0:1783137630.598547:0:13218:0:(genops.c:906:class_export_put()) final put ffff9709bf1f8800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1783137630.598603:0:13218:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9709b7c81800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1783137630.598607:0:13218:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9709b7c81800 2 00000020:01000004:3.0:1783137630.598611:0:13218:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9709b7c81800 from lustre-OST0001 00000020:00000080:3.0:1783137630.598634:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137630.598643:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1783137630.598646:0:13218:0:(genops.c:906:class_export_put()) final put ffff9709bd936000/lustre-OST0001_UUID 00000020:00000080:3.0:1783137630.598649:0:13218:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd936000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1783137630.598656:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1783137630.598813:0:13218:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 73e4795b-54a4-4490-bb2a-864b21234c99->MGS 00010000:00010000:3.0:1783137630.598828:0:13218:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709c2172c00/0x88def104ac674752 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac674759 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137630.598840:0:13218:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709c2172c00/0x88def104ac674752 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac674759 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137630.598847:0:13218:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1783137630.598851:0:13218:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1783137630.598854:0:13218:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1783137630.598869:0:13218:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9709ab342800 00010000:00010000:3.0:1783137630.598872:0:13218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709c2172c00/0x88def104ac674752 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac674759 expref: -99 pid: 6616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137630.598886:0:13218:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88def104ac6749a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137630.598893:0:13218:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88def104ac6749a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137630.598898:0:13218:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783137630.598901:0:13218:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1783137630.598902:0:13218:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1783137630.598909:0:13218:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9709ab342800 00010000:00010000:3.0:1783137630.598912:0:13218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac67499e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88def104ac6749a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783137630.598925:0:13218:0:(import.c:65:import_set_state_nolock()) ffff9709ab342800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1783137630.598929:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783137630.598931:0:13218:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783137630.598933:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783137630.598937:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783137630.598953:0:13218:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9709bca7c380 x1869754990153856/t0(0) o250->MGC192.168.203.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783137642 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783137630.599117:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783137630.599121:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1783137630.599247:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73e4795b-54a4-4490-bb2a-864b21234c99:3305:1869754990153856:0@lo:250:kworker.0 10000000:01000000:3.0:1783137630.599384:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783137630.599392:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674641 00000020:00000080:3.0:1783137630.599398:0:13218:0:(genops.c:906:class_export_put()) final put ffff9709ab343800/73e4795b-54a4-4490-bb2a-864b21234c99 00000020:00000080:2.0:1783137630.599646:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bf1f8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1783137630.599735:0:13218:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.136@tcp (flags='') 00000020:00000080:3.0:1783137630.599741:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137630.599747:0:13218:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.136@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783137630.599752:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9709873db380) has no exports 10000000:01000000:1.0:1783137630.599835:0:5811:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1783137630.599957:0:13218:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.136@tcp: client import never connected 00000100:00080000:3.0:1783137630.599960:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1783137630.599963:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783137630.599964:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783137630.599966:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783137630.600269:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709ab343800/73e4795b-54a4-4490-bb2a-864b21234c99 for MGC192.168.203.136@tcp 00000020:00000080:3.0:1783137630.600359:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783137630.600365:0:13218:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.136@tcp (uuid 73e4795b-54a4-4490-bb2a-864b21234c99) 00000020:01000000:3.0:1783137630.600372:0:13218:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783137630.600375:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137630.600379:0:13218:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783137630.600384:0:13218:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9709b1979800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137630.600389:0:13218:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9709afe3cd40) has exports, disconnecting them 00000020:00080000:3.0:1783137630.600393:0:13218:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9709b1979800), last request at 1783137433 00000020:00000080:3.0:1783137630.600397:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac674878 00000020:00080000:3.0:1783137630.600407:0:13218:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9709b1979800): rc 0 00000020:00000080:3.0:1783137630.600411:0:13218:0:(genops.c:906:class_export_put()) final put ffff9709b1979800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783137630.600522:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709ab342800 for MGC192.168.203.136@tcp 00000020:00000080:2.0:1783137630.600528:0:5309:0:(genops.c:906:class_export_put()) final put ffff9709ab347800/73e4795b-54a4-4490-bb2a-864b21234c99 00000020:00000080:2.0:1783137630.600531:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709ab347800/73e4795b-54a4-4490-bb2a-864b21234c99 for MGC192.168.203.136@tcp 00000020:01000000:2.0:1783137630.600535:0:5309:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.136@tcp (73e4795b-54a4-4490-bb2a-864b21234c99) 00000020:00000080:2.0:1783137630.601514:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b1979800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1783137630.602842:0:13218:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783137630.602850:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137630.602855:0:13218:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783137630.602862:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783137630.602996:0:5309:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9709b197b800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1783137630.611852:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1783137630.612173:0:11060:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1783137630.612275:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1783137630.612428:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff97099ce3e200:5798] 1 exiting: rc = 0 00000100:00100000:3.0:1783137630.612730:0:5797:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff97098b662000:5797] 0 exiting: rc = 1 00000100:00100000:1.0:1783137630.612841:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137630.613241:0:8403:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9709afe19e00:8403] 3 exiting: rc = 0 00000100:00100000:3.0:1783137630.613312:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97098b663200:5799] 0 exiting: rc = 1 00000100:00100000:3.0:1783137630.617264:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff970997fb5c00:5801] 2 exiting: rc = 0 00000100:00100000:0.0:1783137630.619746:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97098b662600:5800] 1 exiting: rc = 0 00000100:00100000:1.0:1783137630.620182:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620192:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620198:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620204:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620211:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620217:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620224:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620230:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620235:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620240:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620245:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620251:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620257:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620262:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620268:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620273:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620278:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620284:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620289:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620294:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620299:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620304:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620309:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620314:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620319:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620323:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620328:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620333:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620338:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620358:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620363:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620368:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620372:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620377:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620382:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620387:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620392:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620397:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620402:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620407:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620412:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620417:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620421:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620426:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620431:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620449:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620456:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620462:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620467:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620473:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620478:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620484:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620490:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620495:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620500:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620506:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620511:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620516:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620520:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620525:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620531:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620536:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620542:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.620555:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783137630.625599:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137630.625610:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1783137630.625616:0:13218:0:(genops.c:906:class_export_put()) final put ffff9709b7941800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1783137630.625621:0:13218:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7941800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1783137630.625627:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1783137630.625667:0:13218:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9709b7c81800 1 00000020:00000080:1.0:1783137630.625673:0:13218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x88def104ac67481d 00000020:00000080:1.0:1783137630.625678:0:13218:0:(genops.c:906:class_export_put()) final put ffff9709b7997800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1783137630.625690:0:13218:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1783137630.625713:0:5309:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7997800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1783137630.625726:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783137630.625731:0:13218:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783137630.625734:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9709afe399c0) has no exports 00000020:00000080:1.0:1783137630.654858:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137630.654874:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1783137630.654879:0:13218:0:(genops.c:906:class_export_put()) final put ffff9709b7c87000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1783137630.654884:0:13218:0:(genops.c:865:class_export_destroy()) destroying export ffff9709b7c87000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1783137630.654890:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1783137630.655277:0:13218:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9709b7c86800 00000020:01000000:1.0:1783137630.655297:0:13218:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1783137630.655302:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783137630.655305:0:13218:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783137630.655309:0:13218:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9709bd938000) has no exports 00000020:00000080:1.0:1783137630.655331:0:13218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783137630.655337:0:13218:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1783137630.655340:0:13218:0:(genops.c:906:class_export_put()) final put ffff9709bd18e800/OSS_uuid 00000020:00000080:1.0:1783137630.655342:0:13218:0:(genops.c:865:class_export_destroy()) destroying export ffff9709bd18e800/OSS_uuid for OSS 00000020:01000000:1.0:1783137630.655346:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1783137630.655372:0:5810:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783137630.658612:0:6619:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9709897bac00:6619] 1 exiting: rc = 0 00000100:00100000:1.0:1783137630.658698:0:6618:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff970997f1b600:6618] 0 exiting: rc = 1 00000100:00100000:1.0:1783137630.658757:0:6620:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9709897ba400:6620] 2 exiting: rc = 0 00000100:00100000:1.0:1783137630.658831:0:8200:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9709aff06e00:8200] 3 exiting: rc = 0 00000100:00100000:1.0:1783137630.658895:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658903:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658909:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658927:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658933:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658939:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658944:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658949:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658954:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658959:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658963:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658968:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658973:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658988:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658994:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.658999:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659005:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659010:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659016:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659021:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659027:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659033:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659038:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659043:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659048:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659053:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659058:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659062:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659648:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659658:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659663:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659668:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659673:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659679:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659696:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659701:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659719:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659725:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659730:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659734:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659739:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659745:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659750:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659757:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659763:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659769:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659775:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659781:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659786:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659816:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659822:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659827:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659838:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659843:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659848:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659853:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659860:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659864:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659870:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659874:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659879:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659884:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659890:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.659894:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783137630.661588:0:6622:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff970989e37400:6622] 0 exiting: rc = 1 00000100:00100000:3.0:1783137630.662299:0:6623:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9709887f3600:6623] 1 exiting: rc = 0 00000100:00100000:1.0:1783137630.662631:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662640:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662647:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662655:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662661:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662680:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662685:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662691:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662697:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662714:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662721:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662726:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662731:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662737:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662742:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662748:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662755:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662760:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662766:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662771:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662776:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662781:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662787:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662819:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662824:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662829:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662835:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662841:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662848:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662854:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662859:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662863:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662868:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662873:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662879:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662886:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662892:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662898:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662903:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662908:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662934:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662941:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662947:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662952:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662957:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662963:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662969:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662976:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662983:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662991:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.662996:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663001:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663006:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663013:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663020:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663026:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663032:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663037:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663043:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663048:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663053:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663059:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663065:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.663263:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.664445:0:6625:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97098c166c00:6625] 1 exiting: rc = 0 00000100:00100000:1.0:1783137630.664635:0:6624:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9709887f3200:6624] 0 exiting: rc = 1 00000100:00100000:3.0:1783137630.664956:0:6626:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9709887f2600:6626] 2 exiting: rc = 0 00000100:00100000:1.0:1783137630.666207:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666216:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666234:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666240:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666246:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666252:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666257:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666263:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666268:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666285:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666291:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666296:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666303:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666308:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666315:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666320:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666327:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666334:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666340:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666346:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666351:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666356:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666362:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666367:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666373:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666378:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666402:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666409:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666415:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666422:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666428:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666627:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666635:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666641:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666647:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666651:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666656:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666662:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666667:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666672:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666677:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666682:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666687:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666693:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666716:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666721:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666727:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666733:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666738:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666744:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666764:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666771:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666777:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666783:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666788:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666822:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666827:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666832:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666837:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666845:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666851:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666857:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666862:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.666879:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137630.672530:0:6627:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9709887f3000:6627] 0 exiting: rc = 1 00000100:00100000:2.0:1783137630.672647:0:6628:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97098b6d2000:6628] 1 exiting: rc = 0 00000100:00100000:1.0:1783137630.672829:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672837:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672843:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672848:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672853:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672857:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672861:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672866:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672871:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672876:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672881:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672886:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672891:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672896:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672901:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672927:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672933:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672938:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672943:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672948:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672953:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672957:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672961:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672966:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672971:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672976:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672981:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672985:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672990:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.672995:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673001:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673007:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673012:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673017:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673025:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673032:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673038:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673042:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673048:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673055:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673061:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673067:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673072:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673078:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673082:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673088:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673095:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673102:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673108:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673114:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673128:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673134:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673141:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673147:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673152:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673157:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673163:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673170:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673176:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673182:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673188:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673194:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673199:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.673211:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783137630.674260:0:6629:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9709b1f3ea00:6629] 0 exiting: rc = 1 00000100:00100000:2.0:1783137630.674573:0:6630:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9709b1f3f800:6630] 1 exiting: rc = 0 00000100:00100000:1.0:1783137630.674723:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674731:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674737:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674743:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674749:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674755:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674761:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674768:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674775:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674818:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674827:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674832:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674838:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674844:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674850:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674856:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674862:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674868:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674874:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674880:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674886:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674930:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674938:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674944:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674950:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674959:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674965:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674976:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674986:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674992:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.674999:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675005:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675011:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675034:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675042:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675048:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675054:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675060:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675065:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675070:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675076:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675081:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675087:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675093:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675100:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675120:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675129:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675134:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675140:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675147:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675152:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675159:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675164:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675171:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675178:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675184:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675197:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675218:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675226:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675232:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675239:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675245:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675252:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783137630.675268:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783137630.684353:0:13218:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783137647.264112:0:13835:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783137655.754256:0:14248:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783137655.754261:0:14248:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1783137655.754374:0:14248:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9709aff2a000 00000020:01000004:2.0:1783137655.754389:0:14248:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783137655.754398:0:14248:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783137655.754411:0:14248:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9709afe38000) 00000020:00000080:2.0:1783137655.754424:0:14248:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783137655.775444:0:14248:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1783137655.777310:0:14248:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1783137655.777733:0:14248:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1783137655.777826:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:3.0:1783137655.777926:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1783137655.778019:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:3.0:1783137655.778120:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1783137655.778213:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:3.0:1783137655.778309:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1783137655.778563:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:3.0:1783137655.779639:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 780: rc = 0 00100000:10000000:3.0:1783137655.779747:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 780: rc = 0 00100000:10000000:3.0:1783137655.780171:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 707: rc = 0 00100000:10000000:3.0:1783137655.780513:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 707: rc = 0 00100000:10000000:3.0:1783137655.780785:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 707: rc = 0 00100000:10000000:3.0:1783137655.781129:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 707: rc = 0 00100000:10000000:3.0:1783137655.781602:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 707: rc = 0 00100000:10000000:3.0:1783137655.781882:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 707: rc = 0 00100000:10000000:3.0:1783137655.782151:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 707: rc = 0 00100000:10000000:3.0:1783137655.782399:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 707: rc = 0 00100000:10000000:3.0:1783137655.782652:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 707: rc = 0 00100000:10000000:3.0:1783137655.783085:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 707: rc = 0 00100000:10000000:3.0:1783137655.783556:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 707: rc = 0 00100000:10000000:3.0:1783137655.784226:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 707: rc = 0 00100000:10000000:3.0:1783137655.784660:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 717: rc = 0 00100000:10000000:3.0:1783137655.785004:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 717: rc = 0 00100000:10000000:3.0:1783137655.785257:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 717: rc = 0 00100000:10000000:3.0:1783137655.785502:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 717: rc = 0 00100000:10000000:3.0:1783137655.785753:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 717: rc = 0 00100000:10000000:3.0:1783137655.786052:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 717: rc = 0 00100000:10000000:3.0:1783137655.786284:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 717: rc = 0 00100000:10000000:3.0:1783137655.786517:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 717: rc = 0 00100000:10000000:3.0:1783137655.789960:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 717: rc = 0 00100000:10000000:3.0:1783137655.790259:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 717: rc = 0 00100000:10000000:3.0:1783137655.790517:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 717: rc = 0 00100000:10000000:3.0:1783137655.790837:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 717: rc = 0 00100000:10000000:3.0:1783137655.791102:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 717: rc = 0 00100000:10000000:3.0:1783137655.791368:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 717: rc = 0 00100000:10000000:3.0:1783137655.791630:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 717: rc = 0 00100000:10000000:3.0:1783137655.791908:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 717: rc = 0 00100000:10000000:3.0:1783137655.792172:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 717: rc = 0 00100000:10000000:3.0:1783137655.792425:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 717: rc = 0 00100000:10000000:3.0:1783137655.795184:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 717: rc = 0 00100000:10000000:3.0:1783137655.795454:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 717: rc = 0 00100000:10000000:3.0:1783137655.795717:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 717: rc = 0 00100000:10000000:3.0:1783137655.799334:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 717: rc = 0 00100000:10000000:3.0:1783137655.799661:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 717: rc = 0 00100000:10000000:3.0:1783137655.799944:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 717: rc = 0 00100000:10000000:3.0:1783137655.800182:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 717: rc = 0 00100000:10000000:3.0:1783137655.800472:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 717: rc = 0 00100000:10000000:3.0:1783137655.800735:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 717: rc = 0 00100000:10000000:3.0:1783137655.801001:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 717: rc = 0 00100000:10000000:3.0:1783137655.801240:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 717: rc = 0 00100000:10000000:3.0:1783137655.802185:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 717: rc = 0 00100000:10000000:3.0:1783137655.802429:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 717: rc = 0 00100000:10000000:3.0:1783137655.806544:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 717: rc = 0 00100000:10000000:3.0:1783137655.807217:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 270: rc = 0 00100000:10000000:3.0:1783137655.807721:0:14248:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1783137655.810658:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 781: rc = 0 00100000:10000000:3.0:1783137655.811406:0:14248:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1783137655.811483:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 781: rc = 0 00100000:10000000:3.0:1783137655.813351:0:14248:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1783137655.813441:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 781: rc = 0 00100000:10000000:3.0:1783137655.814006:0:14248:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1783137655.814083:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 395: rc = 0 00100000:10000000:3.0:1783137655.814567:0:14248:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1783137655.814639:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 395: rc = 0 00100000:10000000:3.0:1783137655.814922:0:14248:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1783137655.815066:0:14248:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 395: rc = 0 00000020:00000080:3.0:1783137655.815594:0:14248:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783137655.815608:0:14248:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783137655.815618:0:14248:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac675942 00000020:01000004:3.0:1783137655.815625:0:14248:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1783137655.815629:0:14248:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783137655.815634:0:14248:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9709aff2a000 from MGS 00000020:01000004:3.0:1783137655.815638:0:14248:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783137655.815647:0:14248:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9709bd9399c0) 00000020:00000080:3.0:1783137655.815656:0:14248:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783137655.815707:0:14248:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9709aff2a000 from MGS, refs=2 00080000:01000000:3.0:1783137655.815711:0:14248:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783137655.815715:0:14248:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac675950 00000100:00100000:3.0:1783137655.815894:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783137655.816068:0:14248:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783137655.816074:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783137655.817194:0:14248:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783137655.817203:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783137655.818068:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137655.818218:0:14248:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783137655.818224:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783137655.819003:0:14248:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783137655.819010:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783137655.820124:0:14248:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783137655.820134:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783137655.821684:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137655.821689:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137655.821690:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137655.822062:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137655.822065:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137655.822066:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137655.822429:0:14248:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783137655.825122:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1783137655.838596:0:14248:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1783137655.838612:0:14248:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783137655.838615:0:14248:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1783137655.843978:0:14257:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783137655.844267:0:14248:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783137655.844400:0:14248:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783137655.844920:0:14248:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783137655.845269:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137655.845410:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783137655.845416:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783137655.850582:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783137655.850595:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783137655.851206:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783137655.851213:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783137655.852565:0:14248:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783137655.852585:0:14248:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.136@tcp' 00000020:01000004:1.0:1783137655.852586:0:14248:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783137655.852613:0:14248:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.136@tcp (typ=mgc) 00000020:00000080:1.0:1783137655.852625:0:14248:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.136@tcp (ffff9709bd858000) 00000020:00000080:1.0:1783137655.852639:0:14248:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783137655.852704:0:14248:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9709b1deb000@MGC192.168.203.136@tcp: add connection 192.168.203.136@tcp at head 00010000:00010000:1.0:1783137655.852869:0:14248:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.136@tcp-0 is initialized 00000040:01000000:1.0:1783137655.852874:0:14248:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 1 is initialized 00000100:00080000:3.0:1783137655.853054:0:14262:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1783137655.857458:0:14263:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783137655.857570:0:14248:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.136@tcp (uuid fa5ae7e8-ddd7-40d6-9869-0eebcb903814) 00000020:00000080:1.0:1783137655.857591:0:14248:0:(genops.c:1406:class_connect()) connect: client fa5ae7e8-ddd7-40d6-9869-0eebcb903814, cookie 0x88def104ac67595e 00000100:00080000:1.0:1783137655.857603:0:14248:0:(import.c:512:import_select_connection()) MGC192.168.203.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783137655.857609:0:14248:0:(import.c:626:import_select_connection()) MGC192.168.203.136@tcp: import ffff9709b1deb000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:1.0:1783137655.857639:0:14248:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bd076680 x1869754990154240/t0(0) o250->MGC192.168.203.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783137655.857670:0:14248:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import fa5ae7e8-ddd7-40d6-9869-0eebcb903814->MGS 00000020:01000004:1.0:1783137655.857692:0:14248:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783137655.857702:0:14248:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783137655.857715:0:14248:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9709bd85b380) 00000020:00000080:1.0:1783137655.857726:0:14248:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783137655.857884:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3305:1869754990154240:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783137655.857955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137655.858441:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990154240 00000100:00100000:1.0:1783137655.858448:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990154240 00000100:00100000:1.0:1783137655.858508:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137655.858514:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1869754990154240:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1783137655.858543:0:14259:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fa5ae7e8-ddd7-40d6-9869-0eebcb903814@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:1.0:1783137655.858565:0:14259:0:(genops.c:1406:class_connect()) connect: client fa5ae7e8-ddd7-40d6-9869-0eebcb903814, cookie 0x88def104ac67596c 00000100:00080000:1.0:1783137655.858671:0:14259:0:(import.c:65:import_set_state_nolock()) ffff9709b1dea800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783137655.858732:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+5:3305:x1869754990154240:12345-0@lo:250:mount.lustre.0 Request processed in 216us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137655.858739:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137655.863256:0:3305:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783137655.863272:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.136@tcp: connect to target with instance 0 00000100:00080000:1.0:1783137655.863281:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783137655.863286:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783137655.863291:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b1deb000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783137655.863295:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783137655.863354:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783137655.863363:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3305:1869754990154240:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783137655.873018:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137655.873215:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783137655.873221:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783137655.874131:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783137655.874139:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783137655.874455:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783137655.874536:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783137655.875241:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783137655.875390:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783137655.875402:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783137655.884439:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783137655.884468:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783137655.916121:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137655.916295:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783137655.916301:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783137655.917561:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783137655.917571:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783137655.918240:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137655.918381:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783137655.918392:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783137655.918912:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137655.918919:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783137655.919396:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137655.919581:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783137655.919586:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783137655.920157:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137655.920164:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783137655.920710:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137655.920959:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783137655.920964:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783137655.921357:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783137655.921363:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783137655.940928:0:14248:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783137655.941180:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783137655.941185:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783137655.943230:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783137655.943241:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783137655.951503:0:14248:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783137655.951522:0:14248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783137655.952624:0:14248:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783137655.952646:0:14248:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1783137655.952652:0:14248:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783137655.952809:0:14248:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783137655.952844:0:14248:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.136@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783137655.952848:0:14248:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783137655.952850:0:14248:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783137655.952851:0:14248:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137655.952852:0:14248:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137655.952853:0:14248:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137655.952854:0:14248:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137655.952856:0:14248:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783137655.952858:0:14248:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783137655.952859:0:14248:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137655.952860:0:14248:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783137655.952863:0:14248:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783137655.952865:0:14248:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783137655.952866:0:14248:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783137655.952867:0:14248:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137655.952868:0:14248:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137655.952869:0:14248:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137655.952870:0:14248:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137655.952871:0:14248:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783137655.952872:0:14248:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783137655.952873:0:14248:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137655.952874:0:14248:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783137655.952898:0:14248:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783137655.952915:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154368:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783137655.952981:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137655.953033:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ae3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137655.953055:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990154368 00000100:00100000:3.0:1783137655.953062:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990154368 00000100:00100000:3.0:1783137655.953113:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137655.953121:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+5:14248:x1869754990154368:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783137655.953166:0:14261:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783137655.953169:0:14261:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783137655.953172:0:14261:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783137655.953612:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783137655.953986:0:14261:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1783137655.957311:0:14283:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783137655.957320:0:14283:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783137655.957323:0:14283:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783137655.957362:0:14283:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1783137655.959832:0:14261:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783137655.959845:0:14261:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783137655.975723:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+5:14248:x1869754990154368:12345-0@lo:253:mount.lustre.0 Request processed in 22592us (22732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137655.975742:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137655.975966:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154368:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783137655.975981:0:14248:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783137655.975984:0:14248:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783137655.975986:0:14248:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783137655.975987:0:14248:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137655.975988:0:14248:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137655.975989:0:14248:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137655.975990:0:14248:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137655.975991:0:14248:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783137655.975993:0:14248:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783137655.975994:0:14248:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137655.975995:0:14248:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783137655.976014:0:14248:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9709aff2a000 from lustre-MDT0000 10000000:01000000:1.0:1783137655.976037:0:14248:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783137655.976040:0:14248:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783137655.976044:0:14248:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9709bd858000 10000000:01000000:1.0:1783137655.976049:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783137655.976056:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9709bd858000 from 1 10000000:01000000:1.0:1783137655.976059:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783137655.976091:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137655.976102:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137655.976111:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137655.976129:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783137655.976175:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137655.976215:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988632180 going to sleep for 11 seconds 00000100:00100000:3.0:1783137655.976557:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990154496 00000100:00100000:3.0:1783137655.976564:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990154496 00000100:00100000:3.0:1783137655.977482:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137655.977494:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+5:14248:x1869754990154496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783137655.977507:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137655.977534:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd005a00/0x88def104ac67597a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675973 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137655.977558:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd005a00/0x88def104ac67597a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675973 expref: 6 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137655.977568:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd005a00/0x88def104ac67597a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675973 expref: 6 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137655.977575:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005a00, rc 0) 00000100:00100000:3.0:1783137655.977683:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+6:14248:x1869754990154496:12345-0@lo:101:mount.lustre.0 Request processed in 192us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137655.977690:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137655.977770:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137655.977788:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137655.977812:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137655.977871:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783137655.977900:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137655.981816:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137655.981962:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990154624 00000100:00100000:3.0:1783137655.981971:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990154624 00000100:00100000:3.0:1783137655.982014:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783137655.982023:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+6:14248:x1869754990154624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137655.982304:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+6:14248:x1869754990154624:12345-0@lo:501:mount.lustre.0 Request processed in 282us (4402us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783137655.982319:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137655.982476:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154624:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783137655.982510:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783137655.982538:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137655.982549:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137655.982569:0:14248:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9709aff2a000 10000000:01000000:2.0:1783137655.982574:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783137655.982579:0:14248:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9709aff2a000 10000000:01000000:2.0:1783137655.982582:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783137655.982585:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9709aff2a000 from 1 10000000:01000000:2.0:1783137655.982588:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783137655.982617:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051200/0x88def104ac675981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137655.982626:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd051200/0x88def104ac675981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137655.982635:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd051200/0x88def104ac675981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137655.982653:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783137655.982689:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137655.982706:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137655.982846:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990154752 00000100:00100000:3.0:1783137655.982850:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990154752 00000100:00100000:3.0:1783137655.982867:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783137655.982873:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+6:14248:x1869754990154752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783137655.982882:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137655.982893:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd004200/0x88def104ac675988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675981 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137655.982913:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd004200/0x88def104ac675988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675981 expref: 7 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137655.982923:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd004200/0x88def104ac675988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675981 expref: 7 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137655.982931:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004200, rc 0) 00000100:00100000:3.0:1783137655.982962:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+7:14248:x1869754990154752:12345-0@lo:101:mount.lustre.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137655.982968:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137655.983293:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137655.983306:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd051200/0x88def104ac675981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675988 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137655.983315:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd051200/0x88def104ac675981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675988 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137655.983441:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783137655.983463:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051200/0x88def104ac675981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675988 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137655.983478:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd051200/0x88def104ac675981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675988 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137655.983484:0:14248:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783137655.983488:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783137655.983492:0:14248:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9709aff2a000 10000000:01000000:2.0:1783137655.983495:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783137655.983498:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783137655.983500:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783137655.983515:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac67598f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137655.983523:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac67598f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137655.983541:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac67598f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137655.983554:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783137655.983581:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137655.983595:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137655.983705:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990154880 00000100:00100000:0.0:1783137655.983710:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990154880 00000100:00100000:0.0:1783137655.983735:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783137655.983742:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+7:14248:x1869754990154880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783137655.983750:0:14260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137655.983760:0:14260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd235c00/0x88def104ac675996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac67598f expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137655.983776:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd235c00/0x88def104ac675996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac67598f expref: 8 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137655.983813:0:14260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd235c00/0x88def104ac675996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac67598f expref: 8 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137655.983821:0:14260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235c00, rc 0) 00000100:00100000:0.0:1783137655.983858:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+8:14248:x1869754990154880:12345-0@lo:101:mount.lustre.0 Request processed in 116us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137655.983864:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783137655.984044:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990154880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137655.984056:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac67598f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675996 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137655.984063:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac67598f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675996 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137655.984114:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990155008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783137655.984138:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137655.984157:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137655.984206:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990155008 00000100:00100000:0.0:1783137655.984210:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990155008 00000100:00100000:0.0:1783137655.984239:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137655.984245:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+8:14248:x1869754990155008:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137655.984828:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:14248:x1869754990155008:12345-0@lo:501:mount.lustre.0 Request processed in 581us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137655.984835:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137655.985158:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990155008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783137655.985189:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990155136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783137655.985228:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137655.985248:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137655.985569:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990155136 00000100:00100000:0.0:1783137655.985574:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990155136 00000100:00100000:0.0:1783137655.985612:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783137655.985619:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3717850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:14248:x1869754990155136:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783137655.986068:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3717850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:14248:x1869754990155136:12345-0@lo:503:mount.lustre.0 Request processed in 449us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137655.986075:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783137655.986247:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990155136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783137655.986815:0:14284:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14284:1869754990155264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137655.986863:0:14284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137655.986930:0:14284:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988632240 going to sleep for 11 seconds 00000100:00100000:3.0:1783137655.986998:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990155264 00000100:00100000:3.0:1783137655.987003:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990155264 00000100:00100000:3.0:1783137655.987074:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783137655.987083:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:14284:x1869754990155264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137655.987563:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:14284:x1869754990155264:12345-0@lo:502:llog_process_th.0 Request processed in 480us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137655.987570:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783137655.987659:0:14284:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14284:1869754990155264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137655.987683:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137655.987693:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137655.987696:0:14284:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783137655.987701:0:14284:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783137655.987703:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783137655.987716:0:14284:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9709bd8599c0) 00000020:00000080:1.0:1783137655.987731:0:14284:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783137655.987735:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783137655.987871:0:14284:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783137655.987881:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac6759a4 00000020:00000080:1.0:1783137655.988129:0:14284:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783137655.988133:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137655.988137:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137655.988139:0:14284:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783137655.988141:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783137655.988145:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137655.988146:0:14284:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783137655.988149:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783137655.988156:0:14284:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9709bd85cd40) 00000020:00000080:1.0:1783137655.988169:0:14284:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783137655.988173:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783137655.988175:0:14284:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783137655.988178:0:14284:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783137655.988184:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783137655.988227:0:14284:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9709aff2a000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783137655.988246:0:14284:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9709beea8000) 00000020:00000080:1.0:1783137655.988254:0:14284:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783137655.988552:0:14284:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783137655.988559:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac6759b9 00000020:00000080:1.0:1783137655.988645:0:14284:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783137655.988651:0:14284:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783137655.988656:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88def104ac6759c0 00080000:01000000:1.0:1783137655.988661:0:14284:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783137655.988664:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac6759c7 00010000:00010000:0.0:1783137656.074520:0:14284:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1783137656.075623:0:14284:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1783137656.075918:0:14284:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783137656.077264:0:14284:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9709bd938000) 00000020:00000080:3.0:1783137656.077303:0:14284:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783137656.077556:0:14284:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783137656.077564:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac6759d5 00000020:00000080:1.0:1783137656.077969:0:14284:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783137656.090175:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88def104ac6759dc 00000020:00000080:0.0:1783137656.091198:0:14284:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783137656.091216:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137656.091223:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137656.091225:0:14284:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783137656.091229:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137656.091235:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137656.091237:0:14284:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783137656.091241:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783137656.091276:0:14284:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783137656.091290:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137656.091293:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137656.091295:0:14284:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783137656.091297:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783137656.091300:0:14284:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783137656.091301:0:14284:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783137656.091303:0:14284:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783137656.091304:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783137656.091317:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137656.091318:0:14284:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783137656.091321:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783137656.091325:0:14284:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783137656.091328:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137656.091330:0:14284:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783137656.091333:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783137656.091339:0:14284:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.136@tcp to nid 0x20000c0a8cb88 (192.168.203.136@tcp) 00000020:01000000:0.0:1783137656.091364:0:14284:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783137656.091367:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783137656.091383:0:14284:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9709bf1f4d40) 00000020:00000080:0.0:1783137656.091398:0:14284:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1783137656.091403:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783137656.091455:0:14284:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783137656.091461:0:14284:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783137656.091467:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac6759ea 00010000:00080000:0.0:1783137656.095165:0:14284:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9709b1ded000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.136@tcp at head 00010000:00010000:0.0:1783137656.095444:0:14284:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1783137656.096210:0:14284:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783137656.096250:0:14284:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783137656.097520:0:14284:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783137656.097583:0:14284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1783137656.097642:0:14284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1783137656.099180:0:14288:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783137656.099185:0:14288:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783137656.103782:0:14284:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783137656.103990:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783137656.104032:0:14284:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783137656.104050:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac6759f1 00000100:00080000:2.0:1783137656.104061:0:14284:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783137656.104067:0:14284:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9709b1ded000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:2.0:1783137656.104100:0:14284:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bd245880 x1869754990155392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783137656.104166:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990155392:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783137656.104218:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869754990155392 offset 0 length 520: 4 00000100:00080000:2.0:1783137656.104276:0:14284:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783137656.104408:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137656.104412:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137656.104414:0:14284:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783137656.104417:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783137656.104419:0:14284:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1783137656.104423:0:14284:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783137656.104435:0:14284:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783137656.104437:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783137656.104727:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137656.104730:0:14284:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783137656.104735:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783137656.104740:0:14284:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783137656.104744:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137656.104745:0:14284:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783137656.104749:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783137656.104752:0:14284:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.136@tcp to nid 0x20000c0a8cb88 (192.168.203.136@tcp) 00000020:01000000:3.0:1783137656.104773:0:14284:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783137656.104775:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783137656.104808:0:14284:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9709bd93cd40) 00000020:00000080:3.0:1783137656.104825:0:14284:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1783137656.104831:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783137656.104895:0:14284:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783137656.104900:0:14284:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783137656.104907:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88def104ac6759ff 00010000:00080000:3.0:1783137656.104945:0:14284:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97098551c000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.136@tcp at head 00010000:00010000:3.0:1783137656.105156:0:14284:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1783137656.105366:0:14284:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783137656.105388:0:14284:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1783137656.105483:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137656.105494:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990155520:0@lo:400:kworker.0 00000100:00100000:0.0:1783137656.105556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137656.105603:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990155520 00000100:00100000:0.0:1783137656.105610:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990155520 00000100:00100000:0.0:1783137656.105644:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137656.105651:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:3308:x1869754990155520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137656.105698:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:3308:x1869754990155520:12345-0@lo:400:kworker.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137656.105706:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783137656.105752:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990155520:0@lo:400:kworker.0 00000040:00080000:3.0:1783137656.105918:0:14284:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783137656.106012:0:14284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783137656.106083:0:14284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1783137656.114572:0:14290:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783137656.114581:0:14290:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783137656.117980:0:14284:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783137656.117996:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783137656.118032:0:14284:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783137656.118050:0:14284:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac675a06 00000100:00080000:0.0:1783137656.118060:0:14284:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783137656.118068:0:14284:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97098551c000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:0.0:1783137656.118102:0:14284:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bc35ce00 x1869754990155648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783137656.118130:0:14284:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783137656.118188:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137656.118205:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137656.118206:0:14284:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783137656.118210:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137656.118214:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137656.118215:0:14284:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783137656.118217:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783137656.118219:0:14284:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783137656.118221:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137656.118223:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137656.118225:0:14284:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783137656.118227:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137656.118229:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137656.118230:0:14284:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783137656.118233:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783137656.118285:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990155648:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783137656.118401:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869754990155648 offset 0 length 520: 4 00000100:00100000:0.0:1783137656.119521:0:14284:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14284:1869754990155776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137656.119632:0:14284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137656.119668:0:14284:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b3a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137656.119820:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990155776 00000100:00100000:3.0:1783137656.119827:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990155776 00000100:00100000:3.0:1783137656.119873:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783137656.119884:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:14284:x1869754990155776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137656.120127:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:14284:x1869754990155776:12345-0@lo:502:llog_process_th.0 Request processed in 244us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137656.120135:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783137656.120168:0:14284:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14284:1869754990155776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783137656.120195:0:14284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783137656.120201:0:14284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783137656.120203:0:14284:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783137656.120207:0:14284:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783137656.120411:0:14248:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1783137656.120429:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783137656.120448:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac67598f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675996 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.120459:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd051c00/0x88def104ac67598f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675996 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137656.120467:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9709aff2a000 from 1 10000000:01000000:2.0:1783137656.120470:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783137656.120495:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.120504:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.120513:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137656.120538:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990155904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783137656.120569:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137656.120598:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1783137656.120613:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990155904 00000100:00100000:0.0:1783137656.120618:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990155904 00000100:00100000:0.0:1783137656.120647:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783137656.120655:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+9:14248:x1869754990155904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783137656.120664:0:14260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137656.120677:0:14260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675a0d expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137656.120696:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675a0d expref: 10 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137656.120706:0:14260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a0d expref: 10 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137656.120715:0:14260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235800, rc 0) 00000100:00100000:0.0:1783137656.120753:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+10:14248:x1869754990155904:12345-0@lo:101:mount.lustre.0 Request processed in 99us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137656.120776:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783137656.121013:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990155904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137656.121026:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.121035:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137656.121656:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156032:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783137656.121698:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137656.121733:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098a2ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1783137656.127755:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990156032 00000100:00100000:0.0:1783137656.127778:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990156032 00000100:00100000:0.0:1783137656.127869:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783137656.127878:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+10:14248:x1869754990156032:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783137656.127901:0:14261:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783137656.127906:0:14261:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783137656.128006:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+10:14248:x1869754990156032:12345-0@lo:256:mount.lustre.0 Request processed in 129us (6308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137656.128014:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783137656.129724:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156032:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783137656.130364:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783137656.130390:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137656.130402:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137656.130423:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709aff2a000 from 1 10000000:01000000:1.0:1783137656.130426:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137656.130461:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137656.130469:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137656.130478:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137656.130498:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783137656.130564:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137656.130607:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ce86300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137656.130846:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990156160 00000100:00100000:3.0:1783137656.130854:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990156160 00000100:00100000:3.0:1783137656.130892:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137656.130901:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+10:14248:x1869754990156160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783137656.130913:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137656.130927:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675a1b expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.130948:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675a1b expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.130959:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a1b expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.130967:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd005400, rc 0) 00000100:00100000:3.0:1783137656.131004:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14248:x1869754990156160:12345-0@lo:101:mount.lustre.0 Request processed in 104us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137656.131011:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783137656.132019:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137656.132038:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137656.132048:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137656.132112:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137656.132151:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137656.132187:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ce86300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137656.132306:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990156288 00000100:00100000:3.0:1783137656.132311:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990156288 00000100:00100000:3.0:1783137656.132345:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137656.132353:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14248:x1869754990156288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137656.132743:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14248:x1869754990156288:12345-0@lo:501:mount.lustre.0 Request processed in 389us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137656.132774:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783137656.132946:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137656.132975:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783137656.133016:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137656.133035:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ce86300 going to sleep for 11 seconds 00000100:00100000:2.0:1783137656.133093:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990156416 00000100:00100000:2.0:1783137656.133098:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990156416 00000100:00100000:2.0:1783137656.133129:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783137656.133136:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14248:x1869754990156416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783137656.133283:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14248:x1869754990156416:12345-0@lo:503:mount.lustre.0 Request processed in 146us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137656.133290:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783137656.134004:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783137656.134621:0:14292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14292:1869754990156544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137656.134682:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137656.134718:0:14292:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988675300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137656.134893:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990156544 00000100:00100000:3.0:1783137656.134899:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990156544 00000100:00100000:3.0:1783137656.134935:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783137656.134943:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14292:x1869754990156544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137656.135213:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14292:x1869754990156544:12345-0@lo:502:llog_process_th.0 Request processed in 270us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137656.135220:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783137656.139001:0:14292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14292:1869754990156544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783137656.139052:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137656.139064:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137656.139066:0:14292:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783137656.139074:0:14292:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9709aff2a000 00000020:00000080:2.0:1783137656.139077:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783137656.139084:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137656.139086:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137656.139087:0:14292:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783137656.139089:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137656.139091:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137656.139092:0:14292:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783137656.139096:0:14292:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9709aff2a000 00000020:00000080:2.0:1783137656.139107:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783137656.139169:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137656.139173:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137656.139174:0:14292:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783137656.139177:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137656.139179:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137656.139181:0:14292:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783137656.139184:0:14292:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9709aff2a000 00000020:00000080:2.0:1783137656.139185:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783137656.139231:0:14292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14292:1869754990156672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137656.139459:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137656.139502:0:14292:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988675300 going to sleep for 11 seconds 00000100:00100000:1.0:1783137656.139569:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990156672 00000100:00100000:1.0:1783137656.139576:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990156672 00000100:00100000:1.0:1783137656.139626:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783137656.139636:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14292:x1869754990156672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783137656.139891:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14292:x1869754990156672:12345-0@lo:502:llog_process_th.0 Request processed in 247us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137656.139900:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783137656.139942:0:14292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14292:1869754990156672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783137656.139965:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137656.139969:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137656.139971:0:14292:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783137656.139974:0:14292:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783137656.140166:0:14248:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783137656.140185:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137656.140205:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137656.140215:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137656.140250:0:14248:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783137656.140253:0:14248:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9709aff2a000 10000000:01000000:1.0:1783137656.140264:0:14248:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9709aff2a000 10000000:01000000:1.0:1783137656.140268:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783137656.140274:0:14248:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9709aff2a000 from 1 10000000:01000000:1.0:1783137656.140276:0:14248:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783137656.140305:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d600/0x88def104ac675a29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137656.140314:0:14248:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0d600/0x88def104ac675a29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137656.140541:0:14248:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0d600/0x88def104ac675a29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137656.140557:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783137656.140589:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137656.140619:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ce86480 going to sleep for 11 seconds 00000100:00100000:3.0:1783137656.140660:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990156800 00000100:00100000:3.0:1783137656.140665:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990156800 00000100:00100000:3.0:1783137656.140698:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783137656.140706:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14248:x1869754990156800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783137656.140715:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137656.140726:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd004800/0x88def104ac675a30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675a29 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.140744:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd004800/0x88def104ac675a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675a29 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.140753:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd004800/0x88def104ac675a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a29 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.140784:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004800, rc 0) 00000100:00100000:3.0:1783137656.140850:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14248:x1869754990156800:12345-0@lo:101:mount.lustre.0 Request processed in 145us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137656.140857:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783137656.140870:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137656.140894:0:14248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0d600/0x88def104ac675a29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a30 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.140902:0:14248:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0d600/0x88def104ac675a29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675a30 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137656.140956:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783137656.140982:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137656.141009:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988675300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137656.141131:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990156928 00000100:00100000:3.0:1783137656.141136:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990156928 00000100:00100000:3.0:1783137656.141164:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783137656.141170:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14248:x1869754990156928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137656.141399:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14248:x1869754990156928:12345-0@lo:501:mount.lustre.0 Request processed in 228us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137656.141406:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783137656.141541:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990156928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783137656.141569:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990157056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783137656.141602:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137656.141624:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988675300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137656.141859:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990157056 00000100:00100000:3.0:1783137656.141865:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990157056 00000100:00100000:3.0:1783137656.142059:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783137656.142067:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14248:x1869754990157056:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783137656.142205:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14248:x1869754990157056:12345-0@lo:503:mount.lustre.0 Request processed in 139us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137656.142212:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783137656.154958:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990157056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783137656.157579:0:14295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14295:1869754990157184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783137656.157658:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137656.157697:0:14295:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099cf6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137656.163652:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990157184 00000100:00100000:0.0:1783137656.163666:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990157184 00000100:00100000:0.0:1783137656.163737:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783137656.163746:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14295:x1869754990157184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137656.164062:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14295:x1869754990157184:12345-0@lo:502:llog_process_th.0 Request processed in 316us (6403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137656.164069:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783137656.164745:0:14295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14295:1869754990157184:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783137656.164830:0:14295:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783137656.164848:0:14295:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9709bf1f19c0) 00000020:00000080:0.0:1783137656.164867:0:14295:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1783137656.166475:0:14295:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9709aff2a000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783137656.166483:0:14295:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9709aff2a000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783137656.166486:0:14295:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9709aff2a000 4 00010000:00080000:0.0:1783137656.166515:0:14295:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97098551f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.136@tcp at head 00010000:00010000:0.0:1783137656.178075:0:14295:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1783137656.178178:0:14295:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783137656.178218:0:14295:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783137656.178231:0:14295:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88def104ac675a3e 00000100:00080000:0.0:1783137656.178241:0:14295:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783137656.178248:0:14295:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97098551f000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:0.0:1783137656.179610:0:14295:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bc35ca80 x1869754990157312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783137656.179667:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990157312:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783137656.179735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137656.179784:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990157312 00000100:00100000:2.0:1783137656.179822:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990157312 00000100:00080000:0.0:1783137656.179834:0:14295:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783137656.179867:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137656.179875:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1869754990157312:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783137656.181067:0:14295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14295:1869754990157440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783137656.181120:0:14295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137656.181153:0:14295:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137656.184723:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1869754990157312:12345-0@lo:38:llog_process_th.0 Request processed in 4838us (4978us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783137656.184738:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137656.184833:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990157440 00000100:00100000:2.0:1783137656.184841:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990157440 00000100:00100000:2.0:1783137656.184893:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783137656.184901:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14295:x1869754990157440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783137656.190485:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14295:x1869754990157440:12345-0@lo:502:llog_process_th.0 Request processed in 5577us (9357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137656.190501:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783137656.191451:0:14295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14295:1869754990157440:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783137656.191491:0:14295:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783137656.194007:0:14248:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783137656.194035:0:14248:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783137656.194052:0:14248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d600/0x88def104ac675a29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a30 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137656.194066:0:14248:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0d600/0x88def104ac675a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a30 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783137656.194117:0:14248:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783137656.194119:0:14248:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783137656.194120:0:14248:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137656.194121:0:14248:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137656.194123:0:14248:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137656.194124:0:14248:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137656.194126:0:14248:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783137656.194127:0:14248:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783137656.194129:0:14248:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137656.194130:0:14248:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783137656.194134:0:14248:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783137656.194137:0:14248:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783137656.194138:0:14248:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783137656.194139:0:14248:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137656.194140:0:14248:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137656.194146:0:14248:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137656.194148:0:14248:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137656.194149:0:14248:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783137656.194150:0:14248:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783137656.194151:0:14248:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137656.194151:0:14248:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783137656.194175:0:14248:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783137656.194193:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990157568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783137656.194267:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137656.194889:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783137656.194897:0:3305:0:(import.c:65:import_set_state_nolock()) ffff97098551f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783137656.194902:0:3305:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783137656.194906:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990157312:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783137656.195057:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff970989002c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137656.196406:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990157568 00000100:00100000:2.0:1783137656.196418:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990157568 00000100:00100000:2.0:1783137656.196532:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783137656.196545:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14248:x1869754990157568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783137656.197012:0:14260:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783137656.197029:0:14260:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783137656.276396:0:14260:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783137656.276416:0:14260:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783137656.276490:0:14282:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783137656.276496:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783137656.276519:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.276547:0:14282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a0d expref: 12 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.276556:0:14282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.276606:0:14282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac675a0d expref: 12 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.276620:0:14282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac675a0d expref: 12 pid: 14260 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137656.276634:0:14282:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14282:1869754990157696:0@lo:104: 00000100:00100000:2.0:1783137656.276693:0:14282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137656.276745:0:14282:0:(client.c:2701:ptlrpc_set_wait()) set ffff970987e339c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137656.276978:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990157696 00000100:00100000:3.0:1783137656.276985:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990157696 00000100:00100000:3.0:1783137656.277027:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137656.277036:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:14282:x1869754990157696:12345-0@lo:104: 00010000:00010000:3.0:1783137656.277048:0:14249:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277105:0:14249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137656.277112:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:14282:x1869754990157696:12345-0@lo:104: Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137656.277119:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783137656.277143:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137656.277148:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277156:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050400 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137656.277160:0:14255:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277168:0:14255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137656.277175:0:14255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137656.277181:0:14255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137656.277208:0:14255:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277215:0:14255:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137656.277241:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277248:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd050400/0x88def104ac675a0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a14 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277297:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137656.277300:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137656.277301:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137656.277330:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990157824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137656.277361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137656.277428:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990157824 00000100:00100000:3.0:1783137656.277432:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990157824 00010000:00010000:3.0:1783137656.277449:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675a0d expref: 13 pid: 14260 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137656.277471:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137656.277477:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+13:3306:x1869754990157824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137656.277485:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137656.277490:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675a0d expref: 13 pid: 14260 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277499:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac675a0d expref: 13 pid: 14260 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277513:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277519:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783137656.277550:0:14251:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001054813s 00010000:00010000:3.0:1783137656.277554:0:14251:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277560:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277566:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277571:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277575:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137656.277579:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277585:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277592:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137656.277600:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137656.277627:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+13:3306:x1869754990157824:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137656.277634:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137656.277692:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990157824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137656.277980:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd235800/0x88def104ac675a14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac675a0d expref: 12 pid: 14260 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137656.277991:0:14282:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14282:1869754990157696:0@lo:104: 00010000:00010000:2.0:1783137656.278004:0:14282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.278013:0:14282:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.278019:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137656.278025:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd050800/0x88def104ac675a45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137656.294563:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14248:x1869754990157568:12345-0@lo:253:mount.lustre.0 Request processed in 98012us (100295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137656.294576:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783137656.294692:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14248:1869754990157568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783137656.294774:0:14248:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783137656.294778:0:14248:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783137656.294779:0:14248:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783137656.294781:0:14248:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137656.294782:0:14248:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137656.294784:0:14248:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137656.294785:0:14248:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137656.294786:0:14248:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783137656.294788:0:14248:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783137656.294813:0:14248:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137656.294814:0:14248:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783137656.294828:0:14248:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783137656.302783:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137656.303007:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783137656.303293:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137656.303456:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783137656.303757:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137656.303948:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1783137656.307587:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137656.307804:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1783137656.308099:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137656.308331:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1783137656.308610:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1783137656.308767:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1783137656.339630:0:14248:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1783137656.340589:0:14248:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783137656.340666:0:14304:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1783137656.340676:0:14304:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1783137656.341039:0:14305:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1783137656.341112:0:14305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783137656.343246:0:14305:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783137656.343325:0:14305:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783137656.343329:0:14305:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1783137656.345934:0:14248:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783137656.346062:0:14248:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783137656.346501:0:14248:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783137656.346509:0:14248:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783137656.350213:0:14248:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783137656.351253:0:14248:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783137656.353382:0:14248:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783137656.353453:0:14248:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1783137656.355484:0:14248:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1783137656.367815:0:14248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1783137656.441520:0:14248:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783137656.441564:0:14248:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8bdc1c7b988 00100000:10000000:1.0:1783137656.441572:0:14248:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783137656.442500:0:14248:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783137656.442515:0:14248:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783137656.442537:0:14248:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783137656.442563:0:14248:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1783137656.873332:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783137657.062935:0:14263:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783137657.062943:0:14263:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9709aff2a000 from 6 10000000:01000000:3.0:1783137657.062948:0:14263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783137657.062992:0:14263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137657.063003:0:14263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137657.063014:0:14263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137657.063040:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990157952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783137657.063101:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137657.063152:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099cf6ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137657.063216:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990157952 00000100:00100000:2.0:1783137657.063223:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990157952 00000100:00100000:2.0:1783137657.063269:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783137657.063277:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14263:x1869754990157952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137657.063291:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137657.063304:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675a4c expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137657.063325:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675a4c expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137657.063335:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a4c expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137657.063343:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051e00, rc 0) 00000100:00100000:2.0:1783137657.063390:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14263:x1869754990157952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137657.063397:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783137657.063548:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990157952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137657.063561:0:14263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137657.063570:0:14263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137657.063618:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990158080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783137657.063656:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137657.063680:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099cf6ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1783137657.063726:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990158080 00000100:00100000:2.0:1783137657.063731:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990158080 00000100:00100000:2.0:1783137657.063759:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783137657.063766:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14263:x1869754990158080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783137657.063779:0:14260:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783137657.063819:0:14260:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783137657.063822:0:14260:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1783137657.063898:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14263:x1869754990158080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137657.063905:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783137657.063973:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990158080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783137657.064017:0:14263:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783137657.064029:0:14263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137657.064037:0:14263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783137657.193417:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783137657.896530:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137658.216394:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783137658.919550:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137659.951201:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783137660.891588:0:14548:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783137660.981656:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137661.351163:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783137661.351171:0:5309:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783137661.351174:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783137661.351177:0:5309:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783137661.351179:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783137661.351182:0:5309:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783137661.351185:0:5309:0:(import.c:65:import_set_state_nolock()) ffff97098551f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137661.351198:0:5309:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97098551f000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137661.351206:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137661.351229:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990158208:0@lo:400:kworker.0 00000100:00100000:3.0:1783137661.351294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137661.351359:0:5309:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bca7c000 x1869754990158336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783137661.351537:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990158208 00000100:00100000:0.0:1783137661.351544:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990158208 00000100:00100000:0.0:1783137661.351596:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137661.351604:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:3306:x1869754990158208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137661.351657:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:3306:x1869754990158208:12345-0@lo:400:kworker.0 Request processed in 53us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137661.351664:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137661.351695:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990158336:0@lo:38:kworker.0 00000100:00100000:0.0:1783137661.351720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137661.351758:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990158208:0@lo:400:kworker.0 00000100:00100000:3.0:1783137661.351894:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990158336 00000100:00100000:3.0:1783137661.351898:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990158336 00000100:00100000:3.0:1783137661.351927:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137661.351932:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1869754990158336:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783137661.351951:0:14268:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:3.0:1783137661.351984:0:14268:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88def104ac675a5a 00000004:00100000:3.0:1783137661.351997:0:14268:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783137661.352104:0:14268:0:(import.c:65:import_set_state_nolock()) ffff970990630000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137661.352158:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869754990158336:12345-0@lo:38:kworker.0 Request processed in 225us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137661.352165:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783137661.352558:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9709bca7c000 x1869754990158336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783137671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783137661.352570:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783137661.352577:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783137661.352581:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783137661.352583:0:3305:0:(import.c:65:import_set_state_nolock()) ffff97098551f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783137661.352588:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869754990158336:0@lo:38:kworker.0 00010000:00010000:3.0:1783137661.994036:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137663.016323:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137664.046352:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783137664.549676:0:14712:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1118e830 20000000:00000080:3.0:1783137664.549691:0:14712:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9709bf4b9400 uarg=0000000000000000 20000000:01000000:3.0:1783137664.549724:0:14712:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783137664.549731:0:14712:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783137664.549735:0:14712:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783137664.551966:0:14713:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1783137664.552118:0:14712:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783137664.561472:0:14712:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783137664.561506:0:14712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137664.561523:0:14712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a1b expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137664.561531:0:14712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137664.561573:0:14712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac675a1b expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137664.561589:0:14712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac675a1b expref: 11 pid: 14259 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137664.561603:0:14712:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14712:1869754990158464:0@lo:104: 00000100:00100000:0.0:1783137664.561663:0:14712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137664.561758:0:14712:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099cf6e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137664.565975:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990158464 00000100:00100000:2.0:1783137664.565989:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990158464 00000100:00100000:2.0:1783137664.566056:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137664.566076:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:14712:x1869754990158464:12345-0@lo:104: 00010000:00010000:2.0:1783137664.566109:0:14250:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.566277:0:14250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783137664.566284:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:14712:x1869754990158464:12345-0@lo:104: Request processed in 220us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137664.566292:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1783137664.566318:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137664.566325:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.566332:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d200 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137664.566337:0:14254:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.566345:0:14254:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137664.566353:0:14254:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137664.566358:0:14254:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783137664.566400:0:14254:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.566406:0:14254:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137664.566437:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.566445:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709afd0d200/0x88def104ac675a1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a22 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.566463:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137664.566475:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137664.566477:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137664.566481:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990158592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137664.566528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137664.568862:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990158592 00000100:00100000:2.0:1783137664.568885:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990158592 00010000:00010000:2.0:1783137664.569293:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675a1b expref: 12 pid: 14259 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137664.569340:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137664.569350:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:3308:x1869754990158592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137664.569364:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137664.569370:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675a1b expref: 12 pid: 14259 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569382:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac675a1b expref: 12 pid: 14259 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569402:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569410:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569426:0:14251:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569450:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569457:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569475:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569482:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137664.569486:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569494:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569503:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137664.569513:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137664.569581:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:3308:x1869754990158592:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (3052us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137664.569589:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137664.569880:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990158592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783137664.571659:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd005400/0x88def104ac675a22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac675a1b expref: 11 pid: 14259 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137664.571686:0:14712:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14712:1869754990158464:0@lo:104: 00010000:00010000:1.0:1783137664.571706:0:14712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137664.571715:0:14712:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137664.571720:0:14712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137664.571726:0:14712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd234800/0x88def104ac675a61 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137665.063568:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783137666.026433:0:14263:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783137666.026441:0:14263:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709aff2a000 from 10 10000000:01000000:0.0:1783137666.026447:0:14263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783137666.026501:0:14263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137666.026513:0:14263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137666.026524:0:14263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137666.026555:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990158720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783137666.026620:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137666.027312:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ce86540 going to sleep for 11 seconds 00000100:00100000:3.0:1783137666.027548:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990158720 00000100:00100000:3.0:1783137666.027557:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990158720 00000100:00100000:3.0:1783137666.027613:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783137666.027623:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+11:14263:x1869754990158720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137666.027646:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137666.027674:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675a68 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137666.027698:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675a68 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137666.027710:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a68 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137666.027718:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004600, rc 0) 00000100:00100000:3.0:1783137666.027787:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14263:x1869754990158720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137666.027814:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783137666.027924:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990158720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137666.027942:0:14263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137666.027953:0:14263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137666.028087:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990158848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137666.028124:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137666.028147:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade913c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137666.028427:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990158848 00000100:00100000:3.0:1783137666.028434:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990158848 00000100:00100000:3.0:1783137666.028479:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783137666.028487:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14263:x1869754990158848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137666.028754:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14263:x1869754990158848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137666.028761:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783137666.028959:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990158848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137666.031034:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990158976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137666.031114:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137666.031159:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137666.031856:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990158976 00000100:00100000:0.0:1783137666.031864:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990158976 00000100:00100000:0.0:1783137666.031916:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783137666.031925:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14263:x1869754990158976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137666.032144:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14263:x1869754990158976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137666.032151:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783137666.032302:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990158976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783137666.033152:0:14774:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783137666.034055:0:14263:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783137666.034075:0:14263:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137666.034086:0:14263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137666.034098:0:14263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137666.087405:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137666.471064:0:3305:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783137656/real 1783137656] req@ffff9709bc35ce00 x1869754990155648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783137666 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137666.471096:0:3305:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9709bc35ce00 x1869754990155648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783137666 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137666.471130:0:3305:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783137656/real 1783137656] req@ffff9709bd245880 x1869754990155392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783137666 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137666.471142:0:3305:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9709bd245880 x1869754990155392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783137666 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783137666.471161:0:3305:0:(import.c:65:import_set_state_nolock()) ffff97098551c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783137666.471178:0:3305:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783137666.471183:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990155648:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783137666.471188:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b1ded000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783137666.471204:0:3305:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783137666.471208:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990155392:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783137666.471525:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783137666.471529:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783137666.471533:0:36:0:(import.c:65:import_set_state_nolock()) ffff9709b1ded000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137666.471537:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:3.0:1783137666.471542:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783137666.471549:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9709b1ded000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137666.471570:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bca7ce00 x1869754990159232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783137666.471586:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783137666.471589:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783137666.471591:0:36:0:(import.c:65:import_set_state_nolock()) ffff97098551c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137666.471594:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:3.0:1783137666.471596:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783137666.471601:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97098551c000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137666.471613:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bca7e300 x1869754990159360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783137666.471621:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990159232:0@lo:8:kworker.0 00000100:00100000:3.0:1783137666.471673:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990159488:0@lo:400:kworker.0 00000100:00100000:3.0:1783137666.471721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137666.471815:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137666.471824:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990159104:0@lo:400:kworker.0 00000100:00100000:0.0:1783137666.471858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137666.472145:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990159104 00000100:00100000:3.0:1783137666.472152:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990159104 00000100:00100000:3.0:1783137666.472348:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783137666.472360:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:3308:x1869754990159104:12345-0@lo:400:kworker.0 00000400:00000100:1.0:1783137666.472378:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869754990159232 offset 0 length 520: 4 00000100:00100000:1.0:1783137666.472408:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990159360:0@lo:8:kworker.0 00000100:00100000:3.0:1783137666.472420:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:3308:x1869754990159104:12345-0@lo:400:kworker.0 Request processed in 62us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137666.472428:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000400:00000100:1.0:1783137666.472432:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869754990159360 offset 0 length 520: 4 00000100:00100000:2.0:1783137666.472521:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990159488 00000100:00100000:2.0:1783137666.472526:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990159488 00000100:00100000:2.0:1783137666.472563:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783137666.472570:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990159488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137666.472612:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990159488:12345-0@lo:400:kworker.0 Request processed in 42us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137666.472618:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783137666.472659:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9709bca7d500 x1869754990159488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137666.472670:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990159488:0@lo:400:kworker.0 00000100:00100000:3.0:1783137666.481400:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990159104:0@lo:400:kworker.0 00010000:00010000:3.0:1783137667.114130:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137668.138142:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137668.461082:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1783137668.611771:0:14913:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783137668.611776:0:14913:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1783137668.613597:0:14913:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97098b126800 00000020:01000004:1.0:1783137668.613628:0:14913:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783137668.613641:0:14913:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1783137668.613655:0:14913:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9709beeab380) 00000020:00000080:1.0:1783137668.613668:0:14913:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783137668.684674:0:14913:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1783137668.685391:0:14913:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783137668.686700:0:14913:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1783137668.687274:0:14913:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1783137668.687740:0:14913:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783137668.694142:0:14913:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 551: rc = 0 00100000:10000000:0.0:1783137668.694389:0:14913:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:0.0:1783137668.694502:0:14913:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 551: rc = 0 00100000:10000000:0.0:1783137668.695080:0:14913:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 572: rc = 0 00100000:10000000:0.0:1783137668.695329:0:14913:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 572: rc = 0 00100000:10000000:0.0:1783137668.695579:0:14913:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 572: rc = 0 00100000:10000000:0.0:1783137668.695829:0:14913:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 572: rc = 0 00100000:10000000:0.0:1783137668.696087:0:14913:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 572: rc = 0 00100000:10000000:0.0:1783137668.696333:0:14913:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 572: rc = 0 00000020:00000080:0.0:1783137668.697001:0:14913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783137668.697013:0:14913:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783137668.697025:0:14913:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88def104ac675a7d 00000020:01000004:0.0:1783137668.697032:0:14913:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1783137668.697052:0:14913:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.136@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783137668.697056:0:14913:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783137668.697062:0:14913:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783137668.697066:0:14913:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783137668.697077:0:14913:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9709bf1f0000) 00000020:00000080:0.0:1783137668.697087:0:14913:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1783137668.702549:0:14913:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783137668.702721:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783137668.702726:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783137668.714385:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783137668.714396:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783137668.714988:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783137668.714996:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783137668.716487:0:14913:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783137668.716655:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783137668.716661:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783137668.723676:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783137668.723692:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783137668.768351:0:14913:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783137668.768579:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783137668.768594:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783137668.770829:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783137668.770842:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783137668.772263:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783137668.772274:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783137668.775494:0:14913:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783137668.775659:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783137668.775665:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783137668.776775:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783137668.776785:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783137668.836722:0:14913:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783137668.837229:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783137668.837236:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1783137668.841331:0:14913:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1783137668.841348:0:14913:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783137668.842196:0:14913:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783137668.842217:0:14913:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1783137668.842223:0:14913:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783137668.860359:0:14913:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783137668.860399:0:14913:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.136@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1783137668.860404:0:14913:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783137668.860406:0:14913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783137668.860408:0:14913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783137668.860409:0:14913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783137668.860410:0:14913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783137668.860412:0:14913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783137668.860413:0:14913:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783137668.860415:0:14913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783137668.860416:0:14913:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783137668.860420:0:14913:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1783137668.860422:0:14913:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783137668.860424:0:14913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783137668.860430:0:14913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783137668.860431:0:14913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783137668.860432:0:14913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783137668.860433:0:14913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783137668.860444:0:14913:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783137668.860446:0:14913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783137668.860447:0:14913:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783137668.860482:0:14913:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783137668.860501:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990159616:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783137668.860568:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137668.860624:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff970985538b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.860749:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990159616 00000100:00100000:0.0:1783137668.860757:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990159616 00000100:00100000:0.0:1783137668.860828:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783137668.860838:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14913:x1869754990159616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783137668.860866:0:14261:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783137668.860870:0:14261:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783137668.860883:0:14261:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783137668.869092:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14913:x1869754990159616:12345-0@lo:253:mount.lustre.0 Request processed in 8246us (8513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.869106:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783137668.869711:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990159616:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783137668.869727:0:14913:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783137668.869730:0:14913:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783137668.869732:0:14913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783137668.869733:0:14913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783137668.869734:0:14913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783137668.869736:0:14913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783137668.869737:0:14913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783137668.869738:0:14913:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783137668.869740:0:14913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783137668.869741:0:14913:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783137668.869761:0:14913:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97098b126800 from lustre-OST0000 10000000:01000000:3.0:1783137668.869817:0:14913:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783137668.869820:0:14913:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783137668.869827:0:14913:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9709bd858000 local copy 00010000:00010000:3.0:1783137668.869838:0:14913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137668.870218:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990159744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137668.870263:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137668.870360:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff970985538e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.870541:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990159744 00000100:00100000:0.0:1783137668.870548:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990159744 00000100:00100000:0.0:1783137668.870590:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783137668.870598:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14913:x1869754990159744:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137668.870765:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14913:x1869754990159744:12345-0@lo:501:mount.lustre.0 Request processed in 166us (500us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783137668.870772:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783137668.871007:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990159744:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783137668.871024:0:14913:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783137668.871201:0:14913:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783137668.871209:0:14913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.871219:0:14913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137668.871243:0:14913:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97098b126800 10000000:01000000:1.0:1783137668.871247:0:14913:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783137668.871252:0:14913:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9709bd858000 10000000:01000000:1.0:1783137668.871254:0:14913:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1783137668.871257:0:14913:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9709bd858000 from 1 10000000:01000000:1.0:1783137668.871260:0:14913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783137668.871285:0:14913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0ce00/0x88def104ac675a8b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.871304:0:14913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0ce00/0x88def104ac675a8b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.871314:0:14913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0ce00/0x88def104ac675a8b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137668.871348:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990159872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783137668.871378:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.871406:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0480 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.871708:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990159872 00000100:00100000:0.0:1783137668.871715:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990159872 00000100:00100000:0.0:1783137668.871762:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783137668.871769:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+12:14913:x1869754990159872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783137668.871788:0:14261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137668.871824:0:14261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd235000/0x88def104ac675a92 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675a8b expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137668.871845:0:14261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd235000/0x88def104ac675a92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675a8b expref: 13 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137668.871857:0:14261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd235000/0x88def104ac675a92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a8b expref: 13 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137668.871865:0:14261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235000, rc 0) 00000100:00100000:0.0:1783137668.871977:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+13:14913:x1869754990159872:12345-0@lo:101:mount.lustre.0 Request processed in 207us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.871984:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783137668.872692:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990159872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137668.872708:0:14913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0ce00/0x88def104ac675a8b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a92 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.872718:0:14913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0ce00/0x88def104ac675a8b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675a92 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137668.872735:0:14913:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783137668.872752:0:14913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0ce00/0x88def104ac675a8b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a92 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.872758:0:14913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0ce00/0x88def104ac675a8b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675a92 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137668.872766:0:14913:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783137668.872771:0:14913:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783137668.872776:0:14913:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783137668.872786:0:14913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783137668.872987:0:14913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0c200/0x88def104ac675a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.872996:0:14913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0c200/0x88def104ac675a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.873004:0:14913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0c200/0x88def104ac675a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137668.873035:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783137668.873074:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.873111:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0480 going to sleep for 11 seconds 00000100:00100000:2.0:1783137668.873553:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990160000 00000100:00100000:2.0:1783137668.873559:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990160000 00000100:00100000:2.0:1783137668.873600:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783137668.873608:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+13:14913:x1869754990160000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137668.873619:0:14261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137668.873629:0:14261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd051000/0x88def104ac675aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675a99 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137668.873648:0:14261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd051000/0x88def104ac675aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675a99 expref: 14 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137668.873657:0:14261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd051000/0x88def104ac675aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a99 expref: 14 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137668.873665:0:14261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd051000, rc 0) 00000100:00100000:2.0:1783137668.873705:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160000:12345-0@lo:101:mount.lustre.0 Request processed in 97us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137668.873711:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783137668.873990:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137668.874002:0:14913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0c200/0x88def104ac675a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675aa0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.874011:0:14913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0c200/0x88def104ac675a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675aa0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783137668.874688:0:14913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783137668.877203:0:14913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137668.877481:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783137668.877525:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783137668.877572:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783137668.877620:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783137668.877659:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783137668.877693:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783137668.877760:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783137668.877769:0:14913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783137668.877879:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137668.877941:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.877979:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.878539:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990160128 00000100:00100000:0.0:1783137668.878547:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990160128 00000100:00100000:0.0:1783137668.878598:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783137668.878607:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137668.879084:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160128:12345-0@lo:501:mount.lustre.0 Request processed in 476us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.879091:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783137668.879310:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137668.879350:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783137668.879393:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.879445:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1783137668.879553:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990160256 00000100:00100000:3.0:1783137668.879559:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990160256 00000100:00100000:3.0:1783137668.879599:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783137668.879606:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783137668.879950:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160256:12345-0@lo:503:mount.lustre.0 Request processed in 342us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137668.879957:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783137668.880462:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160256:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783137668.881599:0:14913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783137668.881673:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137668.881740:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.882085:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137668.885009:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990160384 00000100:00100000:2.0:1783137668.885022:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990160384 00000100:00100000:2.0:1783137668.885084:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783137668.885094:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783137668.885404:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160384:12345-0@lo:502:mount.lustre.0 Request processed in 311us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137668.885413:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783137668.885660:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783137668.886064:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783137668.886121:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783137668.886156:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783137668.886204:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783137668.886242:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783137668.886275:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783137668.886398:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783137668.886446:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783137668.886497:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1783137668.886541:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1783137668.886573:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1783137668.886623:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1783137668.886663:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137668.886722:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.886766:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.886988:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990160512 00000100:00100000:0.0:1783137668.886995:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990160512 00000100:00100000:0.0:1783137668.887038:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783137668.887046:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783137668.887227:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160512:12345-0@lo:502:mount.lustre.0 Request processed in 181us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.887242:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783137668.887392:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783137668.887471:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1783137668.887481:0:14913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1783137668.889703:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783137668.889715:0:14927:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783137668.889722:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137668.889724:0:14927:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783137668.889741:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783137668.889757:0:14927:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9709afe3b380) 00000020:00000080:2.0:1783137668.889810:0:14927:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783137668.889818:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783137668.889891:0:14927:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97098b126800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783137668.889898:0:14927:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783137668.889904:0:14927:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88def104ac675aae 00010000:00010000:3.0:1783137668.894088:0:14927:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1783137668.894546:0:14927:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1783137668.896701:0:14927:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1783137668.898187:0:14927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783137668.898200:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137668.898206:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137668.898209:0:14927:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783137668.898213:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783137668.898216:0:14927:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783137668.898217:0:14927:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783137668.898219:0:14927:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783137668.898220:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783137668.898223:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137668.898224:0:14927:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783137668.898227:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137668.898230:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137668.898231:0:14927:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783137668.898234:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783137668.898236:0:14927:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783137668.898238:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137668.898240:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137668.898242:0:14927:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783137668.898244:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783137668.898246:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137668.898247:0:14927:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783137668.898250:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783137668.898443:0:14927:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783137668.898448:0:14927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783137668.898449:0:14927:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783137668.898453:0:14927:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1783137668.898617:0:14913:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1783137668.898646:0:14913:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783137668.898661:0:14913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0c200/0x88def104ac675a99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675aa0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.898682:0:14913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0c200/0x88def104ac675a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675aa0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137668.898690:0:14913:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97098b126800 from 1 10000000:01000000:1.0:1783137668.898693:0:14913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783137668.898726:0:14913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.898735:0:14913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.898746:0:14913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137668.898770:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783137668.898863:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.899031:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0240 going to sleep for 11 seconds 00000100:00100000:2.0:1783137668.899102:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990160640 00000100:00100000:2.0:1783137668.899109:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990160640 00000100:00100000:2.0:1783137668.899157:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783137668.899167:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+14:14913:x1869754990160640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783137668.899181:0:14260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137668.899193:0:14260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675ab5 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137668.899217:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675ab5 expref: 15 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137668.899228:0:14260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675ab5 expref: 15 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137668.899237:0:14260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd050600, rc 0) 00000100:00100000:2.0:1783137668.899273:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990160640:12345-0@lo:101:mount.lustre.0 Request processed in 108us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137668.899280:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783137668.900432:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137668.900462:0:14913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.900473:0:14913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783137668.901216:0:14913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783137668.902597:0:14913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137668.904144:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783137668.904209:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783137668.904292:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783137668.904312:0:14913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783137668.904405:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137668.904487:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.904533:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.904848:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990160768 00000100:00100000:0.0:1783137668.904856:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990160768 00000100:00100000:0.0:1783137668.904913:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783137668.904922:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990160768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783137668.905164:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990160768:12345-0@lo:501:mount.lustre.0 Request processed in 242us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.905172:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783137668.906581:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137668.906632:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783137668.906690:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.906728:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.907397:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990160896 00000100:00100000:0.0:1783137668.907405:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990160896 00000100:00100000:0.0:1783137668.907450:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783137668.907459:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990160896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783137668.907646:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990160896:12345-0@lo:503:mount.lustre.0 Request processed in 187us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.907653:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783137668.907739:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd077480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990160896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783137668.908657:0:14913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783137668.908731:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783137668.908983:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137668.909024:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff970985538d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.909135:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990161024 00000100:00100000:0.0:1783137668.909142:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990161024 00000100:00100000:0.0:1783137668.909172:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783137668.909180:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990161024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783137668.909420:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990161024:12345-0@lo:502:mount.lustre.0 Request processed in 239us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.909428:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783137668.910142:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783137668.911100:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783137668.911169:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783137668.911216:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783137668.911272:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783137668.912025:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783137668.912097:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783137668.912134:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783137668.912165:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1783137668.912209:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783137668.912276:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137668.912321:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff970985538d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137668.912504:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990161152 00000100:00100000:1.0:1783137668.912511:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990161152 00000100:00100000:1.0:1783137668.912565:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783137668.912574:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990161152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137668.912767:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990161152:12345-0@lo:502:mount.lustre.0 Request processed in 194us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137668.912776:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783137668.913287:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783137668.913422:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783137668.913445:0:14913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1783137668.916124:0:14931:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137668.916138:0:14931:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137668.916147:0:14931:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783137668.916155:0:14931:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97098b126800 00000020:00000080:2.0:1783137668.916157:0:14931:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783137668.916164:0:14931:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137668.916166:0:14931:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137668.916168:0:14931:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783137668.916170:0:14931:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137668.916173:0:14931:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137668.916174:0:14931:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783137668.916177:0:14931:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97098b126800 00000020:00000080:2.0:1783137668.916179:0:14931:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783137668.916252:0:14931:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137668.916255:0:14931:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137668.916257:0:14931:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783137668.916259:0:14931:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137668.916262:0:14931:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137668.916263:0:14931:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783137668.916266:0:14931:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97098b126800 00000020:00000080:2.0:1783137668.916268:0:14931:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783137668.916412:0:14931:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137668.916416:0:14931:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137668.916417:0:14931:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783137668.916421:0:14931:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1783137668.917432:0:14913:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783137668.917469:0:14913:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783137668.917491:0:14913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.917502:0:14913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137668.917544:0:14913:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783137668.917547:0:14913:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97098b126800 10000000:01000000:1.0:1783137668.917550:0:14913:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97098b126800 10000000:01000000:1.0:1783137668.917553:0:14913:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783137668.917564:0:14913:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97098b126800 from 1 10000000:01000000:1.0:1783137668.917567:0:14913:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783137668.917599:0:14913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0c600/0x88def104ac675ac3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.917607:0:14913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709afd0c600/0x88def104ac675ac3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.917617:0:14913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709afd0c600/0x88def104ac675ac3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137668.917638:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783137668.917699:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.917737:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990161280 00000100:00100000:1.0:1783137668.917742:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990161280 00000100:00100000:1.0:1783137668.918171:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783137668.918186:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990161280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137668.918200:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137668.918212:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0d400/0x88def104ac675aca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675ac3 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.918234:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0d400/0x88def104ac675aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675ac3 expref: 16 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.918245:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0d400/0x88def104ac675aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675ac3 expref: 16 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.918253:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d400, rc 0) 00000100:00100000:1.0:1783137668.918290:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990161280:12345-0@lo:101:mount.lustre.0 Request processed in 109us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137668.918378:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783137668.918425:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0900 going to sleep for 11 seconds 00000100:00100000:1.0:1783137668.918455:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137668.918469:0:14913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709afd0c600/0x88def104ac675ac3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675aca expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.918477:0:14913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709afd0c600/0x88def104ac675ac3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675aca expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783137668.920286:0:14913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1783137668.922661:0:14913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137668.929452:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783137668.929552:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783137668.929592:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783137668.929667:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783137668.929709:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783137668.929757:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783137668.937491:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783137668.937557:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783137668.937623:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783137668.937662:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783137668.937696:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783137668.937744:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783137668.937816:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783137668.937853:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783137668.938089:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783137668.938125:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783137668.938156:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783137668.938199:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783137668.938232:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783137668.939978:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783137668.940095:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783137668.940129:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783137668.940163:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783137668.940209:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783137668.940245:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1783137668.940278:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1783137668.946385:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1783137668.946474:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1783137668.946568:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1783137668.946578:0:14913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1783137668.946677:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137668.946738:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.946816:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0900 going to sleep for 11 seconds 00000100:00100000:2.0:1783137668.950477:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990161408 00000100:00100000:2.0:1783137668.950490:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990161408 00000100:00100000:2.0:1783137668.950551:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783137668.950562:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990161408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783137668.950870:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990161408:12345-0@lo:501:mount.lustre.0 Request processed in 309us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137668.950889:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783137668.951082:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137668.951130:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783137668.951176:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.951238:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.964742:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990161536 00000100:00100000:0.0:1783137668.964756:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990161536 00000100:00100000:0.0:1783137668.964819:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783137668.964829:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990161536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783137668.965050:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990161536:12345-0@lo:503:mount.lustre.0 Request processed in 222us (13873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.965058:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783137668.965253:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783137668.965762:0:14913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783137668.965854:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137668.965919:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.965951:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.966350:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990161664 00000100:00100000:0.0:1783137668.966356:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990161664 00000100:00100000:0.0:1783137668.966403:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783137668.966411:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990161664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783137668.966611:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990161664:12345-0@lo:502:mount.lustre.0 Request processed in 199us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.966618:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783137668.966897:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783137668.967165:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783137668.967217:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783137668.967254:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783137668.967348:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783137668.967389:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783137668.967451:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783137668.967488:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783137668.967525:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783137668.967577:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783137668.967615:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783137668.967652:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783137668.967712:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783137668.967755:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783137668.967817:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783137668.967871:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783137668.967910:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783137668.967946:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783137668.967996:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783137668.968036:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783137668.968084:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783137668.968127:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783137668.968159:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783137668.968186:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783137668.968232:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783137668.968268:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1783137668.968302:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1783137668.968347:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1783137668.968383:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1783137668.968420:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1783137668.968499:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1783137668.968539:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1783137668.968572:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1783137668.968606:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1783137668.968656:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1783137668.968695:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1783137668.968762:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1783137668.968834:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1783137668.968868:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1783137668.968916:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1783137668.968952:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1783137668.968996:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137668.969066:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.969097:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137668.969861:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990161792 00000100:00100000:0.0:1783137668.969869:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990161792 00000100:00100000:0.0:1783137668.969929:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783137668.969939:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990161792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783137668.970166:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990161792:12345-0@lo:502:mount.lustre.0 Request processed in 228us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137668.970175:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783137668.975149:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990161792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783137668.976022:0:14913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1783137668.976043:0:14913:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783137668.979391:0:14936:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783137668.979408:0:14936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9709bd93b380) 00000020:00000080:3.0:1783137668.979440:0:14936:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1783137668.979591:0:14936:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97098b126800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783137668.979596:0:14936:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97098b126800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783137668.979598:0:14936:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97098b126800 3 00010000:00080000:3.0:1783137668.979627:0:14936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9709b197a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.136@tcp at head 00010000:00010000:3.0:1783137668.984701:0:14936:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1783137668.984807:0:14936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783137668.984843:0:14936:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783137668.984857:0:14936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x88def104ac675ad8 00000100:00080000:3.0:1783137668.984866:0:14936:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783137668.986031:0:14936:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9709b197a000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137668.986075:0:14936:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bca7ea00 x1869754990161920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783137668.986108:0:14936:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783137668.986143:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783137668.986148:0:5309:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783137668.986151:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783137668.986154:0:5309:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783137668.986849:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1869754990161920:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783137668.986947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137668.987010:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990162048:0@lo:400:kworker.0 00000100:00100000:3.0:1783137668.987015:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990161920 00000100:00100000:3.0:1783137668.987022:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990161920 00000100:00100000:2.0:1783137668.987035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783137668.992841:0:14936:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1783137668.993854:0:14913:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783137668.994006:0:14913:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783137668.994028:0:14913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0c600/0x88def104ac675ac3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675aca expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137668.994040:0:14913:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0c600/0x88def104ac675ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675aca expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783137668.994089:0:14913:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783137668.994092:0:14913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783137668.994093:0:14913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137668.994094:0:14913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137668.994095:0:14913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137668.994097:0:14913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137668.994099:0:14913:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137668.994100:0:14913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137668.994102:0:14913:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783137668.994105:0:14913:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1783137668.994107:0:14913:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783137668.994109:0:14913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783137668.994110:0:14913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783137668.994111:0:14913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783137668.994112:0:14913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783137668.994118:0:14913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783137668.994119:0:14913:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783137668.994120:0:14913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783137668.994121:0:14913:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783137668.994146:0:14913:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783137668.994165:0:14913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990162176:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783137668.994232:0:14913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137668.994271:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990162176 00000100:00100000:1.0:1783137668.994277:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990162176 00000100:00100000:1.0:1783137668.994315:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783137668.994324:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14913:x1869754990162176:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783137668.994351:0:14261:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783137668.994364:0:14261:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783137668.994710:0:14913:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783137668.997410:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990162048 00000100:00100000:3.0:1783137668.997423:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990162048 00000100:00100000:3.0:1783137668.997558:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137668.997567:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990162048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137668.997652:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990162048:12345-0@lo:400:kworker.0 Request processed in 86us (10615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137668.997660:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137668.997685:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137668.997690:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1869754990161920:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783137668.997711:0:14266:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:3.0:1783137668.997740:0:14266:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88def104ac675adf 00000004:00100000:3.0:1783137668.997754:0:14266:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783137668.998273:0:14266:0:(import.c:65:import_set_state_nolock()) ffff97098c0f4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137668.998337:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869754990161920:12345-0@lo:38:llog_process_th.0 Request processed in 644us (11399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137668.998345:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783137669.000117:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9709bca7f480 x1869754990162048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137669.000133:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990162048:0@lo:400:kworker.0 00010000:00080000:2.0:1783137669.000667:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9709bca7ea00 x1869754990161920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783137678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137669.000677:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783137669.000684:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783137669.000691:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783137669.000696:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783137669.000699:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b197a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783137669.000705:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1869754990161920:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1783137669.043717:0:14261:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783137669.043736:0:14261:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783137669.044665:0:14282:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783137669.044672:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783137669.044693:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.044712:0:14282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a4c expref: 16 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.044723:0:14282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.044764:0:14282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac675a4c expref: 16 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.044823:0:14282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac675a4c expref: 16 pid: 14259 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137669.044857:0:14282:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14282:1869754990162304:0@lo:104: 00000100:00100000:2.0:1783137669.045078:0:14282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137669.045128:0:14282:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709b784f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137669.045241:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990162304 00000100:00100000:0.0:1783137669.045250:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990162304 00000100:00100000:0.0:1783137669.045298:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137669.045307:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:14282:x1869754990162304:12345-0@lo:104: 00010000:00010000:0.0:1783137669.045321:0:14250:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137669.045392:0:14250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783137669.045398:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:14282:x1869754990162304:12345-0@lo:104: Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137669.045405:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137669.045473:0:14282:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14282:1869754990162304:0@lo:104: 00010000:00010000:2.0:1783137669.045491:0:14282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137669.045541:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137669.045548:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137669.045556:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005e00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:3.0:1783137669.045561:0:14255:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137669.045570:0:14255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783137669.045578:0:14255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137669.045585:0:14255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137669.045631:0:14255:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137669.045638:0:14255:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783137669.045668:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137669.045676:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a53 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137669.045693:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137669.045696:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137669.045699:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137669.045712:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137669.045723:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3309:1869754990162432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137669.045754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137669.051686:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990162432 00000100:00100000:0.0:1783137669.051700:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990162432 00010000:00010000:0.0:1783137669.051741:0:14253:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675a4c expref: 17 pid: 14259 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137669.051951:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783137669.051962:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:3309:x1869754990162432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137669.051992:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137669.052001:0:14252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675a4c expref: 17 pid: 14259 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052015:0:14252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac675a4c expref: 17 pid: 14259 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052035:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd051e00/0x88def104ac675a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac675a4c expref: 17 pid: 14259 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052054:0:14252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052064:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783137669.052081:0:14252:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007410208s 00010000:00010000:2.0:1783137669.052086:0:14252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052104:0:14252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052111:0:14252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052118:0:14252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052125:0:14252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137669.052129:0:14252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052139:0:14252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052171:0:14252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137669.052182:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783137669.052248:0:14282:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137669.052256:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:3309:x1869754990162432:12345-0@lo:103:ldlm_bl.0 Request processed in 294us (6500us total) trans 0 rc 0/0 00010000:00010000:0.0:1783137669.052263:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137669.052268:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783137669.052277:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd051600/0x88def104ac675ae6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137669.052653:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3309:1869754990162432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137669.069560:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14913:x1869754990162176:12345-0@lo:253:mount.lustre.0 Request processed in 75228us (75319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137669.069576:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783137669.070185:0:14913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14913:1869754990162176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783137669.070201:0:14913:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783137669.070205:0:14913:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783137669.070206:0:14913:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783137669.070207:0:14913:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783137669.070208:0:14913:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783137669.070210:0:14913:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783137669.070224:0:14913:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783137669.070226:0:14913:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783137669.070228:0:14913:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783137669.070229:0:14913:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783137669.070246:0:14913:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783137669.080856:0:14913:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137669.081042:0:14913:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137669.081218:0:14913:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137669.081371:0:14913:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783137669.081527:0:14913:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783137669.081721:0:14913:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783137669.083720:0:14913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783137669.137306:0:14913:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783137669.137314:0:14913:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783137669.137342:0:14913:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783137669.137394:0:14913:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783137669.137406:0:14913:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783137669.137442:0:14913:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1783137669.161203:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137670.182965:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783137670.569192:0:14263:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783137670.569200:0:14263:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9709aff2a000 from 7 10000000:01000000:2.0:1783137670.569205:0:14263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783137670.569250:0:14263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137670.569262:0:14263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137670.569272:0:14263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137670.569294:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990162560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783137670.569352:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137670.569621:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990162560 00000100:00100000:0.0:1783137670.569629:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990162560 00000100:00100000:0.0:1783137670.569680:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783137670.569690:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+15:14263:x1869754990162560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137670.569702:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137670.569716:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675aed expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137670.569738:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675aed expref: 16 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137670.569749:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675aed expref: 16 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137670.569757:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235600, rc 0) 00000100:00100000:2.0:1783137670.571849:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab6840 going to sleep for 11 seconds 00000100:00100000:0.0:1783137670.577207:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14263:x1869754990162560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7507us (7843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137670.577221:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783137670.578351:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990162560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783137670.578389:0:14263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137670.578403:0:14263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137670.578604:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990162688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783137670.578660:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137670.578703:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab6840 going to sleep for 11 seconds 00000100:00100000:1.0:1783137670.578778:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990162688 00000100:00100000:1.0:1783137670.578786:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990162688 00000100:00100000:1.0:1783137670.578845:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783137670.578853:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14263:x1869754990162688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783137670.578872:0:14261:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783137670.578893:0:14261:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783137670.578896:0:14261:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1783137670.578994:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14263:x1869754990162688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137670.579001:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783137670.579336:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990162688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783137670.579535:0:14263:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783137670.579543:0:14263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137670.579552:0:14263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137671.208061:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137672.233716:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137673.254999:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783137674.157243:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783137674.157249:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783137674.157252:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783137674.157255:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783137674.157334:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3309:1869754990162816:0@lo:400:kworker.0 00000100:00100000:3.0:1783137674.157472:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137674.157545:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990163072:0@lo:400:kworker.0 00000100:00100000:0.0:1783137674.157648:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990162816 00000100:00100000:0.0:1783137674.157654:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990162816 00000100:00100000:0.0:1783137674.157692:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783137674.157700:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:3309:x1869754990162816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137674.157757:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:3309:x1869754990162816:12345-0@lo:400:kworker.0 Request processed in 57us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137674.157764:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783137674.157951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137674.158011:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137674.158019:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990162944:0@lo:400:kworker.0 00000100:00100000:3.0:1783137674.158043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137674.164056:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3309:1869754990162816:0@lo:400:kworker.0 00000100:00100000:0.0:1783137674.167819:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990163072 00000100:00100000:0.0:1783137674.167832:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990163072 00000100:00100000:0.0:1783137674.168043:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990162944 00000100:00100000:0.0:1783137674.168047:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990162944 00000100:00100000:0.0:1783137674.168063:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137674.168071:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990163072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137674.168171:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990163072:12345-0@lo:400:kworker.0 Request processed in 101us (10220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137674.168178:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137674.168194:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137674.168199:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990162944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137674.168227:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869754990162944:12345-0@lo:400:kworker.0 Request processed in 28us (10183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137674.168233:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783137674.168320:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bc35dc00 x1869754990162944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137674.168345:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869754990162944:0@lo:400:kworker.0 00010000:00080000:1.0:1783137674.168364:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bc35f800 x1869754990163072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137674.168372:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990163072:0@lo:400:kworker.0 00000100:00080000:3.0:1783137674.168690:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783137674.279216:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137675.303146:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783137676.198131:0:15280:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783137676.328148:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137677.351816:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137678.375135:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137678.696519:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1783137679.272121:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783137679.272129:0:5309:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783137679.272131:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783137679.272134:0:5309:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783137679.272433:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990163456:0@lo:400:kworker.0 00000100:00100000:2.0:1783137679.272504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137679.273890:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990163200:0@lo:400:kworker.0 00000100:00100000:1.0:1783137679.273901:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990163456 00000100:00100000:1.0:1783137679.273911:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990163456 00000100:00100000:3.0:1783137679.273948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137679.273976:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783137679.273987:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137679.273987:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990163456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137679.273998:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990163328:0@lo:400:kworker.0 00000100:00100000:3.0:1783137679.274046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137679.274056:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990163456:12345-0@lo:400:kworker.0 Request processed in 71us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137679.274065:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783137679.274079:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137679.274083:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990163328 00000100:00100000:1.0:1783137679.274087:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990163328 00000100:00100000:1.0:1783137679.274113:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783137679.274120:0:14267:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1783137679.274120:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990163328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137679.274133:0:14267:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1783137679.274161:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990163328:12345-0@lo:400:kworker.0 Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137679.274182:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783137679.274449:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990163200 00000100:00100000:0.0:1783137679.274455:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990163200 00000100:00100000:0.0:1783137679.274490:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783137679.274498:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:3308:x1869754990163200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137679.274537:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:3308:x1869754990163200:12345-0@lo:400:kworker.0 Request processed in 40us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137679.274543:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783137679.275454:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd246a00 x1869754990163456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137679.275471:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990163456:0@lo:400:kworker.0 00010000:00080000:3.0:1783137679.275826:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd244380 x1869754990163328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137679.275838:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990163328:0@lo:400:kworker.0 00000100:00100000:3.0:1783137679.275860:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990163200:0@lo:400:kworker.0 00010000:00010000:1.0:1783137679.399103:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137680.423781:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137681.279845:0:3305:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783137666/real 1783137666] req@ffff9709bca7e300 x1869754990159360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783137681 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137681.279872:0:3305:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9709bca7e300 x1869754990159360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783137681 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137681.280896:0:3305:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783137666/real 1783137666] req@ffff9709bca7ce00 x1869754990159232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783137681 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137681.280916:0:3305:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9709bca7ce00 x1869754990159232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783137681 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783137681.280935:0:3305:0:(import.c:65:import_set_state_nolock()) ffff97098551c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783137681.280955:0:3305:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783137681.280958:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990159360:0@lo:8:kworker.0 00000100:00080000:1.0:1783137681.280963:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b1ded000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783137681.280968:0:3305:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783137681.280970:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990159232:0@lo:8:kworker.0 00000100:00080000:3.0:1783137681.281072:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783137681.281076:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783137681.281079:0:36:0:(import.c:65:import_set_state_nolock()) ffff9709b1ded000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137681.281084:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 422 00000100:00080000:3.0:1783137681.281088:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783137681.281095:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9709b1ded000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137681.281124:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bca7f100 x1869754990163712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783137681.281135:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783137681.281138:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783137681.281151:0:36:0:(import.c:65:import_set_state_nolock()) ffff97098551c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137681.281155:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 422 00000100:00080000:3.0:1783137681.281158:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783137681.281162:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97098551c000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137681.281175:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bca7f800 x1869754990163840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783137681.281215:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137681.281226:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990163584:0@lo:400:kworker.0 00000100:00100000:3.0:1783137681.281284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137681.281334:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990163968:0@lo:400:kworker.0 00000100:00100000:3.0:1783137681.281371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137681.281392:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137681.281397:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990164096:0@lo:400:kworker.0 00000100:00100000:3.0:1783137681.281415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137681.281442:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990163584 00000100:00100000:3.0:1783137681.281448:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990163584 00000100:00100000:3.0:1783137681.281486:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783137681.281495:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:3306:x1869754990163584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137681.281539:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:3306:x1869754990163584:12345-0@lo:400:kworker.0 Request processed in 45us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137681.281546:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783137681.281586:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990163968 00000100:00100000:3.0:1783137681.281590:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990163968 00000100:00100000:3.0:1783137681.281612:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990164096 00000100:00100000:3.0:1783137681.281615:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990164096 00000100:00100000:3.0:1783137681.281648:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783137681.281653:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990163968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137681.281698:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990163968:12345-0@lo:400:kworker.0 Request processed in 44us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137681.281705:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783137681.281718:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783137681.281724:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990164096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137681.281748:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869754990164096:12345-0@lo:400:kworker.0 Request processed in 24us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137681.281753:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783137681.281780:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990163584:0@lo:400:kworker.0 00000100:00080000:3.0:1783137681.281827:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783137681.281844:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bca7dc00 x1869754990164096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137681.281854:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1869754990164096:0@lo:400:kworker.0 00010000:00080000:3.0:1783137681.281864:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bca7c380 x1869754990163968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137681.281870:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990163968:0@lo:400:kworker.0 00000100:00100000:1.0:1783137681.282019:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990163712:0@lo:8:kworker.0 00000100:00100000:1.0:1783137681.282050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137681.282086:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990163840:0@lo:8:kworker.0 00000100:00100000:1.0:1783137681.282107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137681.282984:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990163712 00000100:00100000:3.0:1783137681.282993:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990163712 00000100:00100000:3.0:1783137681.283015:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990163840 00000100:00100000:3.0:1783137681.283018:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990163840 00000100:00100000:3.0:1783137681.283030:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137681.283035:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1869754990163712:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783137681.283059:0:14915:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:3.0:1783137681.283094:0:14915:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac675afb 00002000:00100000:3.0:1783137681.283128:0:14915:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9709b7c83800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113655 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783137681.283132:0:14915:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783137681.283135:0:14915:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783137681.283453:0:14915:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783137681.283476:0:14915:0:(import.c:65:import_set_state_nolock()) ffff9709b7c86800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137681.283539:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869754990163712:12345-0@lo:8:kworker.0 Request processed in 501us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137681.283547:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783137681.283850:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bca7f100 x1869754990163712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783137701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137681.283861:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783137681.283867:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783137681.283874:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783137681.283879:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783137681.283882:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9709b1ded000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783137681.283898:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783137681.283912:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990163712:0@lo:8:kworker.0 00000100:00100000:3.0:1783137681.287431:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137681.287441:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1869754990163840:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783137681.287464:0:14915:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783137681.287565:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1869754990163840:12345-0@lo:8:kworker.0 Request processed in 114us (5448us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783137681.287575:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:3.0:1783137681.287651:0:14289:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1783137681.287671:0:14289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14289:1869754990164352:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783137681.287710:0:14289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137681.287729:0:14289:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137681.287744:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990164224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137681.287765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137681.287813:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990164352 00000100:00100000:3.0:1783137681.287820:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990164352 00000100:00100000:3.0:1783137681.287860:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783137681.287867:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14289:x1869754990164352:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1783137681.288256:0:3305:0:(import.c:65:import_set_state_nolock()) ffff97098551c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783137681.288262:0:3305:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783137681.288265:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990163840:0@lo:8:kworker.0 00000100:00080000:1.0:1783137681.293708:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137681.293742:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990164224 00000100:00100000:1.0:1783137681.293751:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990164224 00000100:00100000:1.0:1783137681.293817:0:14918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137681.293827:0:14918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1869754990164224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137681.293861:0:14918:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137681.293944:0:14918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1869754990164224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (6176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137681.293951:0:14918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1783137681.295459:0:14288:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783137681.295745:0:14288:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437192952449ns, next at 0ns, rc = 0 00010000:00080000:2.0:1783137681.295945:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bca7c380 x1869754990164224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137681.295973:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990164224:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1783137681.302396:0:14915:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1783137681.302408:0:14915:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1783137681.302421:0:14915:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1783137681.320679:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.320689:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.320704:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.320709:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.320715:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.320732:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.320743:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.320751:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.320776:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137681.321221:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137681.321228:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.321237:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137681.321241:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.321250:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.321267:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.321284:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e4f1a25/0x88def104ac675b02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.321300:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.321302:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.321304:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.321545:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.321552:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.321622:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.321626:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.321637:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.321646:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.321653:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.321660:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.321720:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783137681.322250:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.322257:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.322266:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.322269:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.322273:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.322285:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.322293:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.322312:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.322896:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783137681.322905:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.322913:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137681.322917:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.322926:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.322945:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.322951:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008279b70a/0x88def104ac675b09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.322973:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137681.322977:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.322984:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137681.322987:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.322995:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.323014:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.323024:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137681.323026:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137681.323028:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137681.332872:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783137681.332886:0:14915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cac993ac/0x88def104ac675b10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.333191:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.335813:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.335826:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.335843:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.335848:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.335855:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.335868:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.335879:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.335886:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.335917:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137681.336366:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137681.336373:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.336382:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137681.336387:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.336397:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.336414:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.336421:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000de8e5e1/0x88def104ac675b17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.336441:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137681.336442:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137681.336444:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.338557:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.338568:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.338582:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.338586:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.338591:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.338603:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.338611:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.338618:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.338643:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783137681.338838:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137681.338847:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.338857:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137681.338862:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.338872:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.338902:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.338910:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b16a343/0x88def104ac675b1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.338930:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137681.338933:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137681.338935:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.339068:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.339074:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.339082:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.339092:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.342186:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.342219:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.342232:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.342241:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.342261:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783137681.342829:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.342838:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.342849:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.342854:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.342859:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.342868:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.342877:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.342891:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.342907:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783137681.343638:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783137681.343646:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343656:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137681.343661:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343670:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343687:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343694:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d62343d/0x88def104ac675b25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343711:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137681.343715:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343721:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137681.343724:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343732:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343756:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343763:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000551a2d9d/0x88def104ac675b2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137681.343776:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137681.343778:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137681.343780:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.345993:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.346004:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346019:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.346023:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.346029:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346041:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346050:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346057:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346088:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783137681.346501:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.346507:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346521:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.346525:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.346529:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346537:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346545:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346553:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.346561:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783137681.348700:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783137681.348712:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348725:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137681.348730:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348741:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348760:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348767:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000305540a7/0x88def104ac675b33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348818:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137681.348822:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348828:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137681.348831:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348839:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348848:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348854:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e2cd6a5/0x88def104ac675b3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.348863:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137681.348864:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137681.348866:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.349432:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.349441:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.349454:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.349459:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.349465:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.349477:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.349498:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.349507:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.350842:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783137681.351377:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.351384:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.351397:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.351400:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.351406:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.351417:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.351426:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.351434:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783137681.352318:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1783137681.352896:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783137681.352904:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.352915:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137681.352926:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.352937:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.352955:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.352963:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f57c81e0/0x88def104ac675b41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.352981:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137681.352985:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.352992:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137681.352995:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.353003:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.353012:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.353020:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137681.353027:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137681.353029:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137681.357331:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137681.359185:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783137681.359199:0:14915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac1b3204/0x88def104ac675b48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137681.359859:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.359868:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.359881:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.359885:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.359891:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.359904:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.359914:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.359922:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.362664:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137681.362678:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.362691:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137681.362695:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.362706:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.362723:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137681.362782:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137681.362785:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137681.362787:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137681.367940:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783137681.367955:0:14915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000544f9289/0x88def104ac675b4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783137681.368583:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.368592:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.368605:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.368609:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.368615:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.368629:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.368638:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.368645:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.368666:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783137681.369092:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.369099:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369108:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.369111:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.369124:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369133:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369141:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369147:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369155:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783137681.369544:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.369551:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369560:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.369563:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.369567:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369576:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369583:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369601:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.369609:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1783137681.370033:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.370039:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.370047:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.370050:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.370054:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.370063:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.370070:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.370076:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.370083:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783137681.376253:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783137681.376267:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376281:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137681.376287:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376300:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376320:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376327:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079de9146/0x88def104ac675b56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376371:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783137681.376381:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376388:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137681.376391:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376398:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376409:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376416:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000289ad890/0x88def104ac675b5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376432:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783137681.376435:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376442:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137681.376445:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376452:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376473:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376481:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000110eaa13/0x88def104ac675b64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376493:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137681.376496:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376502:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137681.376505:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376512:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376521:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376527:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cf6e194/0x88def104ac675b6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.376537:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.376539:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.376545:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137681.381397:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.393904:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.393917:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.393942:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.393945:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.393952:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.393968:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.393977:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.393985:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.394003:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783137681.395184:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.395193:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395206:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.395209:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.395214:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395225:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395246:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395253:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395272:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783137681.395879:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.395886:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395896:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.395899:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.395903:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395912:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395920:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395928:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.395945:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1783137681.396315:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.396321:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396330:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.396333:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.396337:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396345:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396364:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396371:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396379:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1783137681.396725:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.396731:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396739:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.396746:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.396750:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396760:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396768:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396775:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.396782:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1783137681.397144:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.397150:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.397158:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.397160:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.397164:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.397173:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.397181:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.397192:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.397200:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1783137681.402540:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.402553:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.402581:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.402585:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.402591:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.402605:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.402615:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.402623:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.402633:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1783137681.404232:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.404243:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404262:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.404266:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.404271:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404283:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404292:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404300:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404311:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1783137681.404734:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783137681.404740:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404749:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7200 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137681.404754:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404764:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404814:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404823:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c8a4c7c/0x88def104ac675b72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404854:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783137681.404857:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404863:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137681.404866:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404872:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404881:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404888:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000736f0739/0x88def104ac675b79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404901:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783137681.404904:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404917:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137681.404920:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404927:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404937:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404944:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb7f7318/0x88def104ac675b80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404958:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783137681.404962:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404968:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137681.404971:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404977:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404985:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.404999:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040163475/0x88def104ac675b87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.405012:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783137681.405015:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.405021:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6200 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137681.405024:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.405032:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.405041:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.405048:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088c82021/0x88def104ac675b8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.405058:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783137681.405062:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.405068:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137681.405077:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406179:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406195:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406201:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa442de2/0x88def104ac675b95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406220:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137681.406224:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406230:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137681.406234:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406241:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406250:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406257:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675b9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406276:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137681.406279:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406285:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137681.406288:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406296:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406305:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406311:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675ba3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.406327:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137681.406329:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137681.406331:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137681.406372:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.409394:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.409406:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.409422:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.409434:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.409440:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.409454:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.409465:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.409472:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.409495:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137681.411317:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137681.411327:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.411339:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137681.411344:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.411365:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.411383:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.411391:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bad5b315/0x88def104ac675baa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.411413:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.411415:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.411417:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.412385:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.412395:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.412409:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.412413:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.412418:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.412430:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.412438:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.412450:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.412476:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137681.413664:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137681.413675:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.413686:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137681.413690:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.413712:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.413728:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.413734:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a934f10/0x88def104ac675bb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.413761:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.413763:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.413764:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783137681.415456:0:14915:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783137681.415468:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.415485:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783137681.415490:0:14915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137681.415497:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.415510:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.415521:0:14915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.415528:0:14915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137681.415554:0:14915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137681.416188:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137681.416197:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.416207:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137681.416211:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.416221:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.416239:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.416260:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088458884/0x88def104ac675bb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137681.416280:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.416282:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137681.416284:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783137681.417329:0:14915:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1783137681.417446:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14289:x1869754990164352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 129576us (129731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137681.417465:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783137681.418220:0:14289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14289:1869754990164352:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783137681.418235:0:14289:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1783137681.418281:0:14289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14289:1869754990164480:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783137681.418320:0:14289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137681.418368:0:14289:0:(client.c:2701:ptlrpc_set_wait()) set ffff970987e33e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783137681.418901:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990164480 00000100:00100000:2.0:1783137681.418908:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990164480 00000100:00100000:2.0:1783137681.419598:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137681.419611:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14289:x1869754990164480:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783137681.419654:0:14916:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1783137681.430648:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14289:x1869754990164480:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11034us (12321us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783137681.430661:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137681.430722:0:14289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14289:1869754990164480:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783137681.430736:0:14289:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1783137681.451859:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783137682.108502:0:15583:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783137682.108506:0:15583:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1783137682.108648:0:15583:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9709b7c85800 00000020:01000004:3.0:1783137682.108662:0:15583:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783137682.108673:0:15583:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1783137682.108686:0:15583:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff970988740000) 00000020:00000080:3.0:1783137682.108702:0:15583:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783137682.167032:0:15583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1783137682.167283:0:15583:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783137682.173173:0:15583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1783137682.173628:0:15583:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1783137682.174108:0:15583:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783137682.175408:0:15583:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 523: rc = 0 00100000:10000000:0.0:1783137682.175528:0:15583:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 523: rc = 0 00100000:10000000:0.0:1783137682.175633:0:15583:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 523: rc = 0 00100000:10000000:0.0:1783137682.176082:0:15583:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 676: rc = 0 00100000:10000000:0.0:1783137682.176462:0:15583:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 676: rc = 0 00100000:10000000:0.0:1783137682.179697:0:15583:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 676: rc = 0 00100000:10000000:0.0:1783137682.180030:0:15583:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 676: rc = 0 00100000:10000000:0.0:1783137682.180277:0:15583:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 676: rc = 0 00100000:10000000:0.0:1783137682.180565:0:15583:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 676: rc = 0 00000020:00000080:0.0:1783137682.181168:0:15583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1783137682.181181:0:15583:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783137682.181194:0:15583:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88def104ac675bc6 00000020:01000004:0.0:1783137682.181203:0:15583:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1783137682.181225:0:15583:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.136@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783137682.181228:0:15583:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783137682.181235:0:15583:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1783137682.181255:0:15583:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1783137682.181259:0:15583:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783137682.206064:0:15583:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783137682.206114:0:15583:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.136@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783137682.206120:0:15583:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783137682.206122:0:15583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783137682.206123:0:15583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783137682.206125:0:15583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783137682.206126:0:15583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783137682.206127:0:15583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783137682.206129:0:15583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783137682.206130:0:15583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783137682.206132:0:15583:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783137682.206136:0:15583:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783137682.206138:0:15583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783137682.206144:0:15583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783137682.206145:0:15583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783137682.206146:0:15583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783137682.206147:0:15583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783137682.206148:0:15583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783137682.206149:0:15583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783137682.206150:0:15583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783137682.206151:0:15583:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783137682.206176:0:15583:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783137682.206197:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990164608:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783137682.206263:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.206452:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970997f57900 going to sleep for 11 seconds 00000100:00100000:1.0:1783137682.207017:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990164608 00000100:00100000:1.0:1783137682.207026:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990164608 00000100:00100000:1.0:1783137682.207079:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783137682.207089:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:15583:x1869754990164608:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783137682.207118:0:14259:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783137682.207121:0:14259:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783137682.207124:0:14259:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783137682.228246:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:15583:x1869754990164608:12345-0@lo:253:mount.lustre.0 Request processed in 21150us (21975us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137682.228261:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783137682.228375:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990164608:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783137682.228390:0:15583:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783137682.228393:0:15583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783137682.228395:0:15583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783137682.228396:0:15583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783137682.228397:0:15583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783137682.228399:0:15583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783137682.228400:0:15583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783137682.228402:0:15583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783137682.228403:0:15583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783137682.228405:0:15583:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783137682.228423:0:15583:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9709b7c85800 from lustre-OST0001 10000000:01000000:3.0:1783137682.228457:0:15583:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783137682.228460:0:15583:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783137682.228468:0:15583:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9709bd858000 local copy 00010000:00010000:3.0:1783137682.228478:0:15583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137682.228718:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990164736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137682.228752:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.228787:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137682.228953:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990164736 00000100:00100000:1.0:1783137682.228960:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990164736 00000100:00100000:1.0:1783137682.228998:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783137682.229005:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:15583:x1869754990164736:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137682.229163:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:15583:x1869754990164736:12345-0@lo:501:mount.lustre.0 Request processed in 158us (410us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783137682.229180:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783137682.229493:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990164736:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783137682.229508:0:15583:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783137682.229687:0:15583:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783137682.229695:0:15583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.229711:0:15583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709afd0d800/0x88def104ac675973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac67597a expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137682.229733:0:15583:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9709b7c85800 10000000:01000000:0.0:1783137682.229743:0:15583:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783137682.229749:0:15583:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783137682.229752:0:15583:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783137682.229756:0:15583:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783137682.229758:0:15583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783137682.229781:0:15583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd234000/0x88def104ac675bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.229818:0:15583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd234000/0x88def104ac675bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.229828:0:15583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd234000/0x88def104ac675bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137682.229843:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990164864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783137682.229876:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137682.229901:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098c0df300 going to sleep for 11 seconds 00000100:00100000:1.0:1783137682.230609:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990164864 00000100:00100000:1.0:1783137682.230616:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990164864 00000100:00100000:1.0:1783137682.230658:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783137682.230667:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:15583:x1869754990164864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137682.230686:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137682.230706:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0c000/0x88def104ac675bd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675bcd expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.230727:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0c000/0x88def104ac675bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675bcd expref: 17 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.230738:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0c000/0x88def104ac675bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675bcd expref: 17 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.230746:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0c000, rc 0) 00000100:00100000:1.0:1783137682.230826:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990164864:12345-0@lo:101:mount.lustre.0 Request processed in 160us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137682.230832:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783137682.231028:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990164864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783137682.231054:0:15583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd234000/0x88def104ac675bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675bd4 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.231064:0:15583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd234000/0x88def104ac675bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675bd4 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137682.232215:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783137682.233381:0:15583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783137682.233654:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783137682.233719:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783137682.233759:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783137682.233861:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783137682.233902:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783137682.233930:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783137682.233994:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783137682.234002:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783137682.234077:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990164992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137682.234136:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.234181:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab6900 going to sleep for 11 seconds 00000100:00100000:1.0:1783137682.234593:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990164992 00000100:00100000:1.0:1783137682.234600:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990164992 00000100:00100000:1.0:1783137682.234650:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783137682.234659:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990164992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137682.235021:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990164992:12345-0@lo:501:mount.lustre.0 Request processed in 362us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137682.235029:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783137682.235992:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990164992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137682.236038:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165120:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783137682.236106:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.236132:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab6900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137682.236185:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990165120 00000100:00100000:0.0:1783137682.236191:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990165120 00000100:00100000:0.0:1783137682.236231:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783137682.236239:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990165120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783137682.236552:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990165120:12345-0@lo:503:mount.lustre.0 Request processed in 314us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137682.236560:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783137682.236641:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165120:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783137682.237367:0:15583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783137682.237429:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783137682.237476:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.237507:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab6900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137682.237638:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990165248 00000100:00100000:0.0:1783137682.237644:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990165248 00000100:00100000:0.0:1783137682.237688:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783137682.237695:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990165248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783137682.237898:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990165248:12345-0@lo:502:mount.lustre.0 Request processed in 203us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137682.237910:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783137682.238569:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783137682.239628:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783137682.239679:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783137682.239711:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783137682.239762:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783137682.239829:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783137682.239867:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783137682.239918:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783137682.239953:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783137682.239995:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1783137682.240035:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783137682.240337:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.240391:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab6900 going to sleep for 11 seconds 00000100:00100000:0.0:1783137682.240426:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990165376 00000100:00100000:0.0:1783137682.240432:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990165376 00000100:00100000:0.0:1783137682.240522:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783137682.240529:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990165376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783137682.240712:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990165376:12345-0@lo:502:mount.lustre.0 Request processed in 182us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137682.240719:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783137682.240832:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783137682.240903:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1783137682.240913:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1783137682.245762:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783137682.245775:0:15585:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1783137682.245783:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137682.245785:0:15585:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783137682.245820:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783137682.245836:0:15585:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff970988744d40) 00000020:00000080:3.0:1783137682.245860:0:15585:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783137682.245865:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783137682.245933:0:15585:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9709b7c85800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783137682.245941:0:15585:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783137682.245948:0:15585:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88def104ac675be2 00010000:00010000:3.0:1783137682.256864:0:15585:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1783137682.259848:0:15585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1783137682.261511:0:15585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1783137682.269144:0:15585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783137682.269156:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137682.269162:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137682.269164:0:15585:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783137682.269167:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137682.269171:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137682.269173:0:15585:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783137682.269175:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783137682.269177:0:15585:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783137682.269179:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137682.269181:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137682.269182:0:15585:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783137682.269184:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783137682.269187:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137682.269188:0:15585:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783137682.269191:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783137682.269322:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783137682.269326:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783137682.269337:0:15585:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783137682.269352:0:15585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1783137682.269905:0:15583:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1783137682.269936:0:15583:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783137682.269955:0:15583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd234000/0x88def104ac675bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675bd4 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.269965:0:15583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd234000/0x88def104ac675bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675bd4 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137682.269973:0:15583:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709b7c85800 from 1 10000000:01000000:3.0:1783137682.269976:0:15583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783137682.270009:0:15583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.270017:0:15583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.270027:0:15583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137682.270050:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783137682.270111:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.270155:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ab6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137682.270228:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990165504 00000100:00100000:1.0:1783137682.270235:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990165504 00000100:00100000:1.0:1783137682.270281:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783137682.270289:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:15583:x1869754990165504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137682.270302:0:14261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137682.270314:0:14261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675be9 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.270334:0:14261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675be9 expref: 18 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.270364:0:14261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675be9 expref: 18 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.270372:0:14261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0cc00, rc 0) 00000100:00100000:1.0:1783137682.270408:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc972c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990165504:12345-0@lo:101:mount.lustre.0 Request processed in 119us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137682.270413:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783137682.270599:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783137682.270614:0:15583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.270623:0:15583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783137682.271317:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783137682.272194:0:15583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137682.281755:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783137682.281878:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783137682.281956:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783137682.281964:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783137682.282081:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137682.282142:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137682.282178:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970989b990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137682.285406:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990165632 00000100:00100000:3.0:1783137682.285419:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990165632 00000100:00100000:3.0:1783137682.285497:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783137682.285507:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990165632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137682.286017:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990165632:12345-0@lo:501:mount.lustre.0 Request processed in 510us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137682.286025:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783137682.286196:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd076300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783137682.286258:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783137682.286305:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137682.286333:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709add48300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137682.288462:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990165760 00000100:00100000:3.0:1783137682.288474:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990165760 00000100:00100000:3.0:1783137682.288581:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783137682.288592:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990165760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783137682.289817:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3716050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990165760:12345-0@lo:503:mount.lustre.0 Request processed in 1222us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137682.289829:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783137682.290930:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165760:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783137682.291484:0:15583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783137682.291576:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd074e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137682.291641:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137682.297015:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990165888 00000100:00100000:2.0:1783137682.297030:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990165888 00000100:00100000:1.0:1783137682.297045:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970989b99300 going to sleep for 11 seconds 00000100:00100000:0.0:1783137682.297293:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783137682.297306:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990165888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137682.298686:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990165888:12345-0@lo:502:mount.lustre.0 Request processed in 1377us (7039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137682.298705:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783137682.298977:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd074e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990165888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783137682.299330:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783137682.299541:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783137682.299656:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783137682.299693:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783137682.300066:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783137682.300130:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783137682.300174:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783137682.300281:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1783137682.300326:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137682.300530:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137682.300653:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709add48300 going to sleep for 11 seconds 00000100:00100000:3.0:1783137682.300769:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990166016 00000100:00100000:3.0:1783137682.300776:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990166016 00000100:00100000:3.0:1783137682.300991:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783137682.300999:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990166016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783137682.301262:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990166016:12345-0@lo:502:mount.lustre.0 Request processed in 205us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137682.301271:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783137682.301355:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783137682.301468:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783137682.301479:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1783137682.309473:0:15589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137682.309485:0:15589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137682.309487:0:15589:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783137682.309494:0:15589:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9709b7c85800 00000020:00000080:3.0:1783137682.309497:0:15589:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783137682.309505:0:15589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137682.309507:0:15589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137682.309520:0:15589:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783137682.309523:0:15589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137682.309526:0:15589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137682.309527:0:15589:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783137682.309530:0:15589:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9709b7c85800 00000020:00000080:3.0:1783137682.309533:0:15589:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783137682.310412:0:15589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137682.310419:0:15589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137682.310420:0:15589:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783137682.310425:0:15589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783137682.310428:0:15589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137682.310430:0:15589:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783137682.310435:0:15589:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9709b7c85800 00000020:00000080:3.0:1783137682.310437:0:15589:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783137682.310501:0:15589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783137682.310505:0:15589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783137682.310506:0:15589:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783137682.310510:0:15589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1783137682.319882:0:15583:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783137682.319937:0:15583:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783137682.319960:0:15583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.319973:0:15583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783137682.320022:0:15583:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783137682.320024:0:15583:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9709b7c85800 10000000:01000000:3.0:1783137682.320028:0:15583:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9709b7c85800 10000000:01000000:3.0:1783137682.320033:0:15583:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783137682.320039:0:15583:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9709b7c85800 from 1 10000000:01000000:3.0:1783137682.320043:0:15583:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783137682.320087:0:15583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd005000/0x88def104ac675bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.320098:0:15583:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd005000/0x88def104ac675bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.320110:0:15583:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd005000/0x88def104ac675bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137682.320135:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783137682.320200:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.320253:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709897eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1783137682.326891:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990166144 00000100:00100000:1.0:1783137682.326904:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990166144 00000100:00100000:1.0:1783137682.326962:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783137682.326972:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990166144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137682.326988:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137682.327006:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0d000/0x88def104ac675bfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675bf7 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.327032:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0d000/0x88def104ac675bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675bf7 expref: 19 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.327043:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0d000/0x88def104ac675bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675bf7 expref: 19 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.327059:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0d000, rc 0) 00000100:00100000:1.0:1783137682.327135:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3717050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990166144:12345-0@lo:101:mount.lustre.0 Request processed in 164us (6934us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137682.327142:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783137682.327201:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783137682.327222:0:15583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd005000/0x88def104ac675bf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675bfe expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137682.327246:0:15583:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd005000/0x88def104ac675bf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675bfe expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783137682.327878:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1783137682.328155:0:15583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783137682.328385:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783137682.328429:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783137682.328459:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783137682.328502:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783137682.328537:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783137682.328586:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783137682.328649:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783137682.328680:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783137682.328728:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783137682.328760:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783137682.328787:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783137682.328863:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783137682.328901:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783137682.328934:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783137682.328980:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783137682.329025:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783137682.329058:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783137682.329101:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783137682.329136:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783137682.329166:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783137682.329211:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783137682.329244:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783137682.329296:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783137682.329360:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783137682.329399:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1783137682.329433:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1783137682.329483:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1783137682.329519:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1783137682.329552:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1783137682.329599:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1783137682.329634:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1783137682.329668:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1783137682.329702:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1783137682.329759:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1783137682.329828:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1783137682.329881:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1783137682.329917:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1783137682.330000:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1783137682.330009:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1783137682.330100:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137682.340747:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137682.340805:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783137682.341356:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990166272 00000100:00100000:3.0:1783137682.341365:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990166272 00000100:00100000:3.0:1783137682.341420:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783137682.341429:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990166272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783137682.341759:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3714450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990166272:12345-0@lo:501:mount.lustre.0 Request processed in 331us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137682.341767:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783137682.342127:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783137682.342173:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783137682.342219:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137682.342686:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783137682.342762:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990166400 00000100:00100000:0.0:1783137682.342769:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990166400 00000100:00100000:0.0:1783137682.344772:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783137682.344787:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990166400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783137682.345149:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3716c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990166400:12345-0@lo:503:mount.lustre.0 Request processed in 366us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137682.345157:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783137682.345984:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783137682.346728:0:15583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783137682.346963:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137682.347014:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137682.347053:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137682.347063:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990166528 00000100:00100000:2.0:1783137682.347070:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990166528 00000100:00100000:2.0:1783137682.347104:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783137682.347113:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990166528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783137682.347381:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990166528:12345-0@lo:502:mount.lustre.0 Request processed in 268us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137682.347390:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783137682.347821:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783137682.348373:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783137682.348429:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783137682.348716:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783137682.348772:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783137682.351143:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783137682.352504:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783137682.352562:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783137682.352592:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783137682.352920:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783137682.353117:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783137682.353155:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783137682.353207:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783137682.353254:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783137682.353314:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783137682.353379:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783137682.353418:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783137682.353452:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783137682.353495:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783137682.353530:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783137682.353561:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783137682.353742:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783137682.353779:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783137682.354019:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783137682.354084:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783137682.354122:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1783137682.354156:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1783137682.354203:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1783137682.354310:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1783137682.354360:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1783137682.354430:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1783137682.354465:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1783137682.354498:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1783137682.354530:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1783137682.354573:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1783137682.354787:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1783137682.354878:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1783137682.354915:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1783137682.355179:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1783137682.355231:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1783137682.355360:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1783137682.355413:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783137682.355496:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137682.355546:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988ad86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783137682.355957:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990166656 00000100:00100000:2.0:1783137682.355965:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990166656 00000100:00100000:2.0:1783137682.356012:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783137682.356021:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3717850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990166656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783137682.356258:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3717850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990166656:12345-0@lo:502:mount.lustre.0 Request processed in 237us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137682.356265:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783137682.356725:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990166656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783137682.356826:0:15583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1783137682.356912:0:15583:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1783137682.362178:0:15594:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783137682.362194:0:15594:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9709beea99c0) 00000020:00000080:1.0:1783137682.362218:0:15594:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1783137682.363467:0:15594:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9709b7c85800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783137682.363473:0:15594:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9709b7c85800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783137682.363476:0:15594:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9709b7c85800 3 00010000:00080000:1.0:1783137682.363507:0:15594:0:(ldlm_lib.c:102:import_set_conn()) imp ffff970989d20800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.136@tcp at head 00010000:00010000:1.0:1783137682.368156:0:15594:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1783137682.368415:0:15594:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783137682.368453:0:15594:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783137682.368587:0:15594:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x88def104ac675c0c 00000100:00080000:1.0:1783137682.368598:0:15594:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783137682.368604:0:15594:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff970989d20800 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:1.0:1783137682.368635:0:15594:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bd075f80 x1869754990166784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783137682.368664:0:15594:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783137682.368839:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1869754990166784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783137682.368906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783137682.368982:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783137682.368993:0:5309:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783137682.368996:0:5309:0:(import.c:65:import_set_state_nolock()) ffff97098551c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783137682.368999:0:5309:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1783137682.369004:0:5309:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783137682.369007:0:5309:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97098551c000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:0.0:1783137682.369021:0:5309:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bc35e300 x1869754990167040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783137682.369082:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990166912:0@lo:400:kworker.0 00000100:00100000:0.0:1783137682.369113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137682.369156:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990167168:0@lo:400:kworker.0 00000100:00100000:0.0:1783137682.369180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.369190:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990166912 00000100:00100000:3.0:1783137682.369197:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990166912 00000100:00100000:1.0:1783137682.369421:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990166784 00000100:00100000:1.0:1783137682.369426:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990166784 00000100:00100000:1.0:1783137682.369447:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990167168 00000100:00100000:1.0:1783137682.369450:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990167168 00000100:00100000:1.0:1783137682.369486:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783137682.369495:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990167168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137682.369539:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990167168:12345-0@lo:400:kworker.0 Request processed in 46us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137682.369546:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783137682.369560:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783137682.369564:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1869754990166784:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783137682.369582:0:14266:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1783137682.369624:0:14266:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88def104ac675c13 00000004:00100000:1.0:1783137682.369638:0:14266:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783137682.369664:0:14266:0:(import.c:65:import_set_state_nolock()) ffff97088220f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137682.369669:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783137682.369678:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1869754990166912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137682.369695:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869754990166784:12345-0@lo:38:llog_process_th.0 Request processed in 130us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137682.369702:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783137682.369712:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1869754990166912:12345-0@lo:400:kworker.0 Request processed in 37us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137682.369718:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137682.370011:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990167296:0@lo:400:kworker.0 00000100:00100000:1.0:1783137682.370043:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137682.370078:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990167040:0@lo:8:kworker.0 00000100:00100000:3.0:1783137682.370087:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990167296 00000100:00100000:3.0:1783137682.370091:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990167296 00000100:00100000:1.0:1783137682.370102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137682.370113:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783137682.370125:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990167296:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1783137682.370134:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bd075f80 x1869754990166784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783137692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137682.370144:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783137682.370150:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00100000:3.0:1783137682.370156:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990167296:12345-0@lo:400:kworker.0 Request processed in 32us (112us total) trans 0 rc 0/0 00000100:00080000:1.0:1783137682.370157:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:3.0:1783137682.370162:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1783137682.370162:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783137682.370165:0:3305:0:(import.c:65:import_set_state_nolock()) ffff970989d20800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783137682.370170:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1869754990166784:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783137682.370419:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bc35f480 x1869754990167168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137682.370428:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990167168:0@lo:400:kworker.0 00000100:00100000:0.0:1783137682.370453:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990166912:0@lo:400:kworker.0 00000100:00100000:1.0:1783137682.370536:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990167040 00000100:00100000:1.0:1783137682.370540:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990167040 00000100:00100000:1.0:1783137682.370564:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783137682.370568:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1869754990167040:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783137682.370609:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1869754990167040:12345-0@lo:8:kworker.0 Request processed in 39us (506us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783137682.370615:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783137682.370642:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9709bc35d880 x1869754990167296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783137682.370652:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990167296:0@lo:400:kworker.0 00000100:00100000:0.0:1783137682.370719:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783137682.370724:0:3305:0:(import.c:65:import_set_state_nolock()) ffff97098551c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783137682.370728:0:3305:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783137682.370731:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990167040:0@lo:8:kworker.0 00000040:00080000:1.0:1783137682.371126:0:15594:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1783137682.371275:0:15583:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1783137682.371308:0:15583:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783137682.371326:0:15583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd005000/0x88def104ac675bf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675bfe expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.371356:0:15583:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd005000/0x88def104ac675bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675bfe expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783137682.371400:0:15583:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783137682.371402:0:15583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783137682.371403:0:15583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137682.371404:0:15583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137682.371406:0:15583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137682.371407:0:15583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137682.371408:0:15583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137682.371410:0:15583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137682.371411:0:15583:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137682.371415:0:15583:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1783137682.371417:0:15583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783137682.371419:0:15583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783137682.371420:0:15583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137682.371421:0:15583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137682.371422:0:15583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137682.371423:0:15583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137682.371424:0:15583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137682.371425:0:15583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137682.371426:0:15583:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783137682.371443:0:15583:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783137682.371459:0:15583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990167424:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783137682.371514:0:15583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137682.371581:0:15583:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098872ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1783137682.371973:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990167424 00000100:00100000:1.0:1783137682.371979:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990167424 00000100:00100000:1.0:1783137682.372013:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783137682.372020:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b3714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:15583:x1869754990167424:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783137682.372049:0:14260:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783137682.372062:0:14260:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783137682.450924:0:14260:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783137682.450989:0:14260:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783137682.453940:0:14282:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783137682.453950:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783137682.455029:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.455051:0:14282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675aed expref: 19 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.455060:0:14282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.455111:0:14282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac675aed expref: 19 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.455127:0:14282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac675aed expref: 19 pid: 14259 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137682.455140:0:14282:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14282:1869754990167552:0@lo:104: 00000100:00100000:3.0:1783137682.455198:0:14282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137682.455451:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990167552 00000100:00100000:0.0:1783137682.455460:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990167552 00000100:00100000:0.0:1783137682.455506:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137682.455516:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:14282:x1869754990167552:12345-0@lo:104: 00010000:00010000:0.0:1783137682.455528:0:14250:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137682.455658:0:14282:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ab31ce40 going to sleep for 11 seconds 00010000:00010000:0.0:1783137682.455675:0:14250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783137682.455680:0:14282:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14282:1869754990167552:0@lo:104: 00000100:00100000:0.0:1783137682.455693:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:14282:x1869754990167552:12345-0@lo:104: Request processed in 169us (485us total) trans 0 rc 0/0 00010000:00010000:3.0:1783137682.455698:0:14282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137682.455710:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1783137682.458778:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137682.458811:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137682.458840:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051800 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137682.458844:0:14254:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137682.458855:0:14254:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137682.458863:0:14254:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137682.458868:0:14254:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783137682.459091:0:14254:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.459099:0:14254:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783137682.459161:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990167680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783137682.459222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783137682.459284:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.459292:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd051800/0x88def104ac675aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675af4 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137682.459308:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137682.459309:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137682.459311:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137682.459368:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990167680 00000100:00100000:0.0:1783137682.459375:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990167680 00010000:00010000:0.0:1783137682.459400:0:14253:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675aed expref: 20 pid: 14259 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137682.459461:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783137682.459470:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+20:3306:x1869754990167680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783137682.459482:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137682.459487:0:14253:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675aed expref: 20 pid: 14259 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459497:0:14253:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac675aed expref: 20 pid: 14259 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459510:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd235600/0x88def104ac675af4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac675aed expref: 20 pid: 14259 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459521:0:14253:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459529:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783137682.459554:0:14253:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007410208s 00010000:00010000:0.0:1783137682.459558:0:14253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459565:0:14253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459571:0:14253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459578:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459584:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137682.459588:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459595:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459609:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137682.459619:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137682.459654:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3306:x1869754990167680:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137682.459662:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1783137682.459912:0:14282:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137682.459921:0:14282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137682.459928:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd005c00/0x88def104ac675c1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137682.460161:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990167680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137682.461816:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b3714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:15583:x1869754990167424:12345-0@lo:253:mount.lustre.0 Request processed in 89763us (90269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137682.461840:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783137682.461961:0:15583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:15583:1869754990167424:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783137682.461986:0:15583:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783137682.461989:0:15583:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783137682.461991:0:15583:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783137682.461992:0:15583:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783137682.461993:0:15583:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783137682.461994:0:15583:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783137682.461996:0:15583:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783137682.461997:0:15583:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783137682.461999:0:15583:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783137682.462001:0:15583:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783137682.462012:0:15583:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783137682.469200:0:15583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137682.469394:0:15583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783137682.469551:0:15583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137682.469709:0:15583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00010000:00010000:3.0:1783137682.472007:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1783137682.474330:0:15583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783137682.474660:0:15583:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783137682.478898:0:15583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783137682.595482:0:15583:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783137682.595491:0:15583:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783137682.595523:0:15583:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783137682.595587:0:15583:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.136@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783137682.595601:0:15583:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783137682.595626:0:15583:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1783137683.494973:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783137683.878983:0:14263:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783137683.878990:0:14263:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9709aff2a000 from 8 10000000:01000000:2.0:1783137683.878995:0:14263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783137683.879039:0:14263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709b26e6a00/0x88def104ac675c21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137683.879050:0:14263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709b26e6a00/0x88def104ac675c21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137683.879061:0:14263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709b26e6a00/0x88def104ac675c21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137683.879092:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990167808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783137683.879158:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137683.879218:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137683.879271:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990167808 00000100:00100000:3.0:1783137683.879279:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990167808 00000100:00100000:3.0:1783137683.879344:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783137683.879353:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:14263:x1869754990167808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137683.879367:0:14261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137683.879381:0:14261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709bd004c00/0x88def104ac675c28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675c21 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137683.879404:0:14261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd004c00/0x88def104ac675c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675c21 expref: 19 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137683.879413:0:14261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709bd004c00/0x88def104ac675c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675c21 expref: 19 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137683.879422:0:14261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd004c00, rc 0) 00000100:00100000:3.0:1783137683.879474:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:14263:x1869754990167808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137683.879481:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783137683.879653:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990167808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137683.879668:0:14263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709b26e6a00/0x88def104ac675c21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675c28 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137683.879677:0:14263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709b26e6a00/0x88def104ac675c21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675c28 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137683.879731:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990167936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783137683.879768:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137683.879822:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099cf6e000 going to sleep for 11 seconds 00000100:00100000:2.0:1783137683.880739:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990167936 00000100:00100000:2.0:1783137683.880749:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990167936 00000100:00100000:2.0:1783137683.880821:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783137683.880830:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:14263:x1869754990167936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783137683.880849:0:14260:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783137683.880868:0:14260:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783137683.880872:0:14260:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783137683.880987:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:14263:x1869754990167936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137683.880995:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783137683.881010:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990167936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783137683.881079:0:14263:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783137683.881086:0:14263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709b26e6a00/0x88def104ac675c21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675c28 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137683.881095:0:14263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709b26e6a00/0x88def104ac675c21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675c28 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137684.502078:0:6644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1783137684.502162:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783137684.522727:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137685.543631:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137686.439054:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990168064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137686.439121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137686.439335:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990168064 00000100:00100000:2.0:1783137686.439344:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990168064 00000100:00100000:2.0:1783137686.439402:0:14918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137686.439412:0:14918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990168064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137686.439443:0:14918:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137686.439492:0:14918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990168064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137686.439499:0:14918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137686.439545:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783137686.439632:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990168064:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783137686.439755:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783137686.567921:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783137687.465433:0:5309:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783137687.465440:0:5309:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783137687.465444:0:5309:0:(import.c:65:import_set_state_nolock()) ffff97098551c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783137687.465456:0:5309:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97098551c000 using connection 192.168.203.136@tcp/0@lo 00000100:00100000:3.0:1783137687.465478:0:5309:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9709bca7f800 x1869754990168448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783137687.465550:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990168320:0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.465626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137687.465674:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783137687.465680:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3309:1869754990168192:0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.465720:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137687.465741:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990168832:0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.465766:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137687.465805:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990168576:0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.465827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137687.465844:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137687.465849:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990168704:0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.465868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137687.465899:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990168320 00000100:00100000:3.0:1783137687.465906:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990168320 00000100:00100000:3.0:1783137687.465947:0:14917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137687.465955:0:14917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990168320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.466013:0:14917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990168320:12345-0@lo:400:kworker.0 Request processed in 58us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137687.466020:0:14917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783137687.466041:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990168192 00000100:00100000:3.0:1783137687.466044:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990168192 00000100:00100000:3.0:1783137687.466081:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783137687.466087:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3309:x1869754990168192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.466114:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3309:x1869754990168192:12345-0@lo:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137687.466120:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783137687.466147:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990168832 00000100:00100000:3.0:1783137687.466151:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990168832 00000100:00100000:3.0:1783137687.466177:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990168576 00000100:00100000:3.0:1783137687.466180:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990168576 00000100:00100000:3.0:1783137687.466191:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990168704 00000100:00100000:3.0:1783137687.466193:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990168704 00000100:00100000:3.0:1783137687.466208:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783137687.466213:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990168832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.466241:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869754990168832:12345-0@lo:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137687.466246:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783137687.466256:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783137687.466261:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990168576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.466289:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990168576:12345-0@lo:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137687.466295:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783137687.466317:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137687.466330:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990168704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.466359:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990168704:12345-0@lo:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137687.466364:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137687.466402:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3309:1869754990168192:0@lo:400:kworker.0 00010000:00080000:3.0:1783137687.466414:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b7cabb80 x1869754990168832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137687.466424:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1869754990168832:0@lo:400:kworker.0 00000100:00100000:3.0:1783137687.466434:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990168320:0@lo:400:kworker.0 00000100:00080000:3.0:1783137687.466461:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783137687.466478:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bca7dc00 x1869754990168704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137687.466486:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990168704:0@lo:400:kworker.0 00010000:00080000:3.0:1783137687.466494:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bca7c380 x1869754990168576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783137703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137687.466500:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990168576:0@lo:400:kworker.0 00000100:00100000:0.0:1783137687.469511:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990168448:0@lo:8:kworker.0 00000100:00100000:0.0:1783137687.469592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137687.469865:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990168448 00000100:00100000:3.0:1783137687.469874:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990168448 00000100:00100000:3.0:1783137687.469912:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783137687.469920:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1869754990168448:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783137687.469948:0:14915:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:3.0:1783137687.469977:0:14915:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88def104ac675c2f 00002000:00100000:3.0:1783137687.469989:0:14915:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff970883a6c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113655 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783137687.470002:0:14915:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783137687.470005:0:14915:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783137687.470398:0:14915:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783137687.470423:0:14915:0:(import.c:65:import_set_state_nolock()) ffff970883a6a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137687.470478:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869754990168448:12345-0@lo:8:kworker.0 Request processed in 557us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137687.470486:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783137687.470591:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709bca7f800 x1869754990168448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783137712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783137687.470606:0:3305:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783137687.470784:0:3305:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783137687.470811:0:3305:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783137687.470814:0:3305:0:(import.c:65:import_set_state_nolock()) ffff97098551c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783137687.470828:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783137687.470834:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1869754990168448:0@lo:8:kworker.0 00000004:00080000:3.0:1783137687.471835:0:14291:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1783137687.471856:0:14291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7caad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14291:1869754990169088:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783137687.471909:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137687.471932:0:14291:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709bd0b0240 going to sleep for 11 seconds 00000004:00080000:3.0:1783137687.471954:0:14290:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783137687.472447:0:14290:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443369654233ns, next at 0ns, rc = 0 00000100:00100000:3.0:1783137687.472470:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990169088 00000100:00100000:3.0:1783137687.472476:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990169088 00000100:00100000:3.0:1783137687.472520:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783137687.472528:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14291:x1869754990169088:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783137687.472781:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990168960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137687.472830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137687.478763:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990168960 00000100:00100000:0.0:1783137687.478776:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990168960 00000100:00100000:0.0:1783137687.478848:0:14918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137687.478857:0:14918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1869754990168960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137687.478897:0:14918:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137687.478975:0:14918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1869754990168960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (6143us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137687.478981:0:14918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783137687.479022:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9709b7cabb80 x1869754990168960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783137703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137687.479040:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990168960:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783137687.480438:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1783137687.488466:0:14916:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1783137687.488478:0:14916:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1783137687.488483:0:14916:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1783137687.499276:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.499287:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.501828:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.501840:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.501851:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.501883:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.501895:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.501902:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.501920:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.501935:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.501940:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.501949:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.501953:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.501962:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.501978:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.501985:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000776fe6bf/0x88def104ac675c36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.502009:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.502011:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.502013:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.502519:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.502527:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.502537:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.502540:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.502545:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.502555:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.502563:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.502571:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.502585:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.502593:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.502598:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.503556:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.503561:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.503571:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.503691:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.503698:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad090582/0x88def104ac675c3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.503716:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.503717:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.503719:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.504216:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.504223:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504233:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.504237:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.504242:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504253:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504266:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504274:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504291:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.504301:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.504316:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504323:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.504327:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504335:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504346:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504353:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002239feb2/0x88def104ac675c44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.504365:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.504371:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.504373:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.508080:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.508094:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508110:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.508114:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.508120:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508134:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508144:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508152:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508172:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.508185:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.508190:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508197:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.508201:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508220:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508238:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508244:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eedab566/0x88def104ac675c4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.508261:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.508262:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.508264:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.509854:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.509864:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.509876:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.509881:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.509886:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.509896:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.509905:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.509919:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.509940:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783137687.510382:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.510388:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.510397:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.510400:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.510405:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.510413:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.510421:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.510428:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.510441:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783137687.511040:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783137687.511047:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511062:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd004000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.511067:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511076:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511092:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511099:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ac4d30/0x88def104ac675c52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511115:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.511118:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511124:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005200 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.511126:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511133:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511142:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511154:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c9e5e1f/0x88def104ac675c59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511166:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.511168:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.511169:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.511900:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.511908:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511920:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.511923:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.511928:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511938:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511947:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511954:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511969:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.511978:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.511986:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.511993:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.511996:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512004:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512015:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512022:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc084ca/0x88def104ac675c60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512036:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.512037:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.512039:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.512435:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.512441:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512450:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.512453:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.512457:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512477:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512485:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512493:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512505:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.512513:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.512517:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512523:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.512527:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512534:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512545:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512552:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2a59917/0x88def104ac675c67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.512570:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.512571:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.512573:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.513227:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.513233:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513242:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.513245:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.513249:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513258:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513266:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513273:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513287:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.513296:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.513299:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513329:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.513333:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513340:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513351:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513357:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095983173/0x88def104ac675c6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.513372:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.513373:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.513375:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137687.513613:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.514000:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.514006:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514015:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.514018:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.514022:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514031:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514051:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514058:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514075:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783137687.514460:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.514465:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514473:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.514476:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.514480:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514488:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514495:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514502:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514525:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783137687.514536:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783137687.514541:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514548:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.514552:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514560:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514572:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514767:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eb2f545/0x88def104ac675c75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514781:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.514785:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514806:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050200 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.514809:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514826:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514837:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514843:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f57c81e0/0x88def104ac675c7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.514853:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.514854:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.514856:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.515433:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.515440:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515450:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.515454:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.515458:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515470:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515479:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515492:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515510:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.515522:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.515526:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515534:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.515538:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515547:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515559:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515568:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e2cd6a5/0x88def104ac675c83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.515762:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.515765:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.515766:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.516210:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.516221:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516230:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.516233:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.516237:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516246:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516255:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516262:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516276:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.516284:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.516287:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516294:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.516297:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516316:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516334:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516340:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000305540a7/0x88def104ac675c8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516353:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.516354:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.516356:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.516942:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.516949:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516960:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.516963:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.516968:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516978:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516986:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.516993:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517017:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.517026:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.517031:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517038:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.517041:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517049:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517061:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517068:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b16a343/0x88def104ac675c91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517081:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.517082:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.517084:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.517475:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.517481:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517488:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.517496:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.517500:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517508:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517515:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517521:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.517544:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783137687.517717:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137687.517723:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137687.517731:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137687.517734:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137687.517742:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137687.517756:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137687.517763:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000551a2d9d/0x88def104ac675c98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137687.517778:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137687.517780:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137687.517782:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.518128:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.518135:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518143:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.518146:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.518151:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518160:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518168:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518182:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518197:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.518206:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.518209:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518216:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.518219:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518227:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518237:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518244:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d62343d/0x88def104ac675c9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518258:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.518260:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.518261:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.518888:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.518902:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518912:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.518916:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.518920:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518930:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518937:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518944:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518957:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.518966:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.518969:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518976:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.518979:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.518986:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519003:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519009:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000de8e5e1/0x88def104ac675ca6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519021:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.519023:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.519025:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.519428:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783137687.519430:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.519434:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519442:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.519445:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.519449:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519458:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519466:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519473:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519497:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137687.519505:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.519509:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519515:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd050e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.519519:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.519527:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.520062:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.520073:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e4f1a25/0x88def104ac675cad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.520088:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.520090:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.520092:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.521436:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.521444:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.521457:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.521467:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.521473:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.521486:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.521495:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.521502:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.521518:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783137687.522239:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.522245:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522255:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.522258:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.522262:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522273:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522281:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522294:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522389:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783137687.522403:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783137687.522408:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522416:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051400 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.522420:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522429:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522444:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522451:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1b3204/0x88def104ac675cb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522468:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137687.522471:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522487:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137687.522490:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522497:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522507:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522514:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cac993ac/0x88def104ac675cbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.522528:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.522530:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.522531:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.522687:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.523244:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.523251:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.523261:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.523265:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.523269:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.523279:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.523295:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.523302:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.523330:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137687.523518:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137687.523523:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.523531:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd051e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137687.523534:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.523543:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.523556:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.523563:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008279b70a/0x88def104ac675cc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783137687.523716:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.523722:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.523730:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.523733:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137687.523734:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137687.523737:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.523738:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.523738:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137687.523746:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.523754:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.523761:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.523783:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783137687.523864:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137687.523870:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.523877:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137687.523881:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.523889:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.523901:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.523908:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6e9425f/0x88def104ac675cc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.523932:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.523933:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.523935:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.524196:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.524202:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524210:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.524213:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.524218:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524227:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524235:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524242:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524263:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783137687.524576:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137687.524581:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524589:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980030600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137687.524592:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524600:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524611:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524618:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a59c4019/0x88def104ac675cd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524631:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.524633:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.524635:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.524647:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.524653:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524662:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.524670:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.524675:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524684:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524692:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524699:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.524719:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783137687.524788:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137687.524813:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524830:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137687.524833:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524842:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524853:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524860:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac675cd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.524872:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.524874:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.524875:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.525122:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.525128:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525136:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.525139:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.525144:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525152:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525160:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525173:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525191:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783137687.525296:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137687.525300:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525317:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137687.525321:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525329:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525345:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525352:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065d168fe/0x88def104ac675cde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525365:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.525367:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.525368:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.525588:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.525594:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525603:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.525606:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.525610:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525619:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525628:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525635:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.525653:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783137687.525670:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137687.525674:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525682:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137687.525685:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525693:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525703:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525710:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007c4e8f0/0x88def104ac675ce5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.525733:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.525734:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.525736:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783137687.526044:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.526050:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.526063:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.526066:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.526070:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.526079:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.526088:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.526095:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.526113:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783137687.526131:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783137687.526137:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.526145:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980030000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137687.526148:0:14255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.526156:0:14255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.526168:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.526175:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039a3e1b2/0x88def104ac675cec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137687.526188:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137687.526190:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137687.526191:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783137687.526421:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1783137687.526983:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783137687.526990:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.527000:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1783137687.527003:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137687.527008:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.527017:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.527101:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.527110:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137687.527130:0:14916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783137687.527345:0:14916:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1783137687.527473:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14291:x1869754990169088:12345-0@lo:5:osp-pre-1-0.0 Request processed in 54942us (55560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137687.527482:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783137687.527864:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783137687.527871:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.527879:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137687.527883:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.527890:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.527904:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.527912:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac675cf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137687.527929:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.527931:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137687.527932:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137687.529340:0:14291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7caad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14291:1869754990169088:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783137687.529356:0:14291:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1783137687.529402:0:14291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14291:1869754990169216:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783137687.529448:0:14291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137687.529490:0:14291:0:(client.c:2701:ptlrpc_set_wait()) set ffff97098b0bb000 going to sleep for 11 seconds 00000100:00100000:0.0:1783137687.529735:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990169216 00000100:00100000:0.0:1783137687.529741:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990169216 00000100:00100000:0.0:1783137687.529889:0:14917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783137687.529905:0:14917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14291:x1869754990169216:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783137687.529944:0:14917:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1783137687.535719:0:14917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14291:x1869754990169216:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5805us (6261us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783137687.535731:0:14917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783137687.538651:0:14291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd075f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14291:1869754990169216:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783137687.538669:0:14291:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1783137687.592033:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783137687.931112:0:15940:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:2.0:1783137688.071709:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1783137688.071760:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783137688.615119:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783137688.937229:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783137689.641198:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137689.943257:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137689.943485:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974445696 00000100:00100000:3.0:1783137689.943494:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974445696 00000100:00100000:3.0:1783137689.943546:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:3.0:1783137689.943554:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1869754974445696:12345-192.168.203.36@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783137689.943581:0:14261:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from e12153bb-60a1-4b82-8c05-faed68451b0d@192.168.203.36@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:3.0:1783137689.943611:0:14261:0:(genops.c:1406:class_connect()) connect: client e12153bb-60a1-4b82-8c05-faed68451b0d, cookie 0x88def104ac675cfa 00000100:00080000:3.0:1783137689.943736:0:14261:0:(import.c:65:import_set_state_nolock()) ffff970883a6b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137689.943854:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+5:2350:x1869754974445696:12345-192.168.203.36@tcp:250:mount.lustre.0 Request processed in 299us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137689.943878:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 76 00000100:00100000:3.0:1783137689.966613:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137689.966760:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974445824 00000100:00100000:2.0:1783137689.966770:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974445824 00000100:00100000:2.0:1783137689.966865:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:2.0:1783137689.966875:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+5:13743:x1869754974445824:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783137689.966907:0:14260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137689.966924:0:14260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709b26e7800/0x88def104ac675d01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b79 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137689.966951:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709b26e7800/0x88def104ac675d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b79 expref: 6 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137689.966976:0:14260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709b26e7800/0x88def104ac675d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b79 expref: 6 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137689.966985:0:14260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e7800, rc 0) 00000100:00100000:2.0:1783137689.967045:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+6:13743:x1869754974445824:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 171us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137689.967052:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 77 00000100:00100000:1.0:1783137689.970212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137689.970433:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974445952 00000100:00100000:2.0:1783137689.970442:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974445952 00000100:00100000:2.0:1783137689.970498:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:2.0:1783137689.970517:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+6:13743:x1869754974445952:12345-192.168.203.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783137689.970893:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+6:13743:x1869754974445952:12345-192.168.203.36@tcp:501:mount.lustre.0 Request processed in 376us (689us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783137689.970902:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 78 00000100:00100000:0.0:1783137689.981004:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137689.981198:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974446080 00000100:00100000:3.0:1783137689.981207:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974446080 00000100:00100000:3.0:1783137689.981262:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:3.0:1783137689.981272:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+6:13743:x1869754974446080:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783137689.981298:0:14261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137689.981314:0:14261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980031400/0x88def104ac675d08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72b80 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137689.981342:0:14261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980031400/0x88def104ac675d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b80 expref: 7 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137689.981353:0:14261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980031400/0x88def104ac675d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72b80 expref: 7 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137689.981362:0:14261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980031400, rc 0) 00000100:00100000:3.0:1783137689.981422:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+7:13743:x1869754974446080:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 150us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137689.981429:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 79 00000100:00100000:1.0:1783137689.983447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137689.983535:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974446208 00000100:00100000:3.0:1783137689.983544:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974446208 00000100:00100000:3.0:1783137689.983594:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:3.0:1783137689.983604:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+7:13743:x1869754974446208:12345-192.168.203.36@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783137689.983915:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+8:13743:x1869754974446208:12345-192.168.203.36@tcp:501:mount.lustre.0 Request processed in 311us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137689.983934:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 80 00000100:00100000:0.0:1783137689.991144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137689.991351:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974446336 00000100:00100000:3.0:1783137689.991360:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974446336 00000100:00100000:3.0:1783137689.991417:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:3.0:1783137689.991427:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+8:13743:x1869754974446336:12345-192.168.203.36@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783137689.991837:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+8:13743:x1869754974446336:12345-192.168.203.36@tcp:503:mount.lustre.0 Request processed in 410us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137689.991845:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 81 00000100:00100000:1.0:1783137689.998300:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137689.998756:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974446464 00000100:00100000:2.0:1783137689.998766:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974446464 00000100:00100000:2.0:1783137689.998857:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:2.0:1783137689.998867:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+8:13761:x1869754974446464:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783137689.999232:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+8:13761:x1869754974446464:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 365us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137689.999247:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 82 00000100:00100000:1.0:1783137690.021933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137690.022090:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974446592 00000100:00100000:0.0:1783137690.022109:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974446592 00000100:00100000:0.0:1783137690.022163:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:0.0:1783137690.022173:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+8:13761:x1869754974446592:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137690.022443:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+8:13761:x1869754974446592:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 270us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137690.022452:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 83 00000100:00100000:0.0:1783137690.028844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137690.029051:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974446720 00000100:00100000:3.0:1783137690.029061:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974446720 00000100:00100000:3.0:1783137690.029122:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:3.0:1783137690.029132:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+8:13743:x1869754974446720:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783137690.029147:0:14260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137690.029175:0:14260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980031200/0x88def104ac675d0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72baa expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.029200:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980031200/0x88def104ac675d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72baa expref: 9 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.029209:0:14260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980031200/0x88def104ac675d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72baa expref: 9 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.029217:0:14260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980031200, rc 0) 00000100:00100000:3.0:1783137690.030158:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+9:13743:x1869754974446720:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 1022us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137690.030169:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 84 00000100:00100000:1.0:1783137690.042924:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137690.043322:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974446848 00000100:00100000:2.0:1783137690.043333:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974446848 00000100:00100000:2.0:1783137690.043388:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:2.0:1783137690.043397:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+9:13743:x1869754974446848:12345-192.168.203.36@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783137690.043420:0:14259:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783137690.043442:0:14259:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783137690.043446:0:14259:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783137690.043708:0:14259:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783137690.043712:0:14259:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783137690.049265:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+9:13743:x1869754974446848:12345-192.168.203.36@tcp:256:mount.lustre.0 Request processed in 5860us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137690.049278:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 85 00000100:00100000:0.0:1783137690.053363:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137690.053613:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974446976 00000100:00100000:3.0:1783137690.053622:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974446976 00000100:00100000:3.0:1783137690.053721:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:3.0:1783137690.053732:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+9:13743:x1869754974446976:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783137690.053748:0:14261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137690.053763:0:14261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72bb1 expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.053788:0:14261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bb1 expref: 10 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.053848:0:14261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bb1 expref: 10 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.053857:0:14261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980030a00, rc 0) 00000100:00100000:3.0:1783137690.053915:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13743:x1869754974446976:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 185us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137690.053922:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 86 00000100:00100000:1.0:1783137690.058754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137690.058948:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974447104 00000100:00100000:2.0:1783137690.059076:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974447104 00000100:00100000:2.0:1783137690.059339:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:2.0:1783137690.059351:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13743:x1869754974447104:12345-192.168.203.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783137690.061519:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13743:x1869754974447104:12345-192.168.203.36@tcp:501:mount.lustre.0 Request processed in 2162us (2765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137690.061533:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 87 00000100:00100000:1.0:1783137690.063664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137690.063750:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974447232 00000100:00100000:3.0:1783137690.063758:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974447232 00000100:00100000:2.0:1783137690.064238:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:2.0:1783137690.064328:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13743:x1869754974447232:12345-192.168.203.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783137690.065806:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13743:x1869754974447232:12345-192.168.203.36@tcp:503:mount.lustre.0 Request processed in 1458us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137690.065819:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 88 00000100:00100000:0.0:1783137690.069094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137690.069358:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974447360 00000100:00100000:2.0:1783137690.069367:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974447360 00000100:00100000:2.0:1783137690.069420:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:2.0:1783137690.069428:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13765:x1869754974447360:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783137690.070731:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13765:x1869754974447360:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 1296us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137690.070741:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 89 00000100:00100000:1.0:1783137690.076230:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137690.076610:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974447488 00000100:00100000:2.0:1783137690.076620:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974447488 00000100:00100000:2.0:1783137690.076722:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:2.0:1783137690.076733:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13765:x1869754974447488:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783137690.077000:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13765:x1869754974447488:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 269us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137690.077008:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 90 00000100:00100000:1.0:1783137690.090921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137690.091013:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974447616 00000100:00100000:3.0:1783137690.091027:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974447616 00000100:00100000:3.0:1783137690.091068:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:3.0:1783137690.091076:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1869754974447616:12345-192.168.203.36@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783137690.091103:0:14268:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from dbff8b30-85ae-47b7-8614-cc3f77566a29@192.168.203.36@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:3.0:1783137690.091161:0:14268:0:(genops.c:1406:class_connect()) connect: client dbff8b30-85ae-47b7-8614-cc3f77566a29, cookie 0x88def104ac675d1d 00000004:00100000:3.0:1783137690.091190:0:14268:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1783137690.091196:0:14268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1783137690.159593:0:14268:0:(import.c:65:import_set_state_nolock()) ffff970883a69800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137690.159678:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:2350:x1869754974447616:12345-192.168.203.36@tcp:38:mount.lustre.0 Request processed in 68600us (68763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137690.159689:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:1.0:1783137690.162371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137690.164210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137690.164760:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974447872 00000100:00100000:3.0:1783137690.164770:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974447872 00000100:00100000:3.0:1783137690.164898:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974447744 00000100:00100000:3.0:1783137690.164902:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974447744 00000100:00100000:3.0:1783137690.164926:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:3.0:1783137690.164936:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:13743:x1869754974447872:12345-192.168.203.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783137690.164989:0:15443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783137690.165200:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:1.0:1783137690.165211:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:0:x1869754974447744:12345-192.168.203.36@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783137690.165226:0:14266:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783137690.165307:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:0:x1869754974447744:12345-192.168.203.36@tcp:41:mount.lustre.0 Request processed in 98us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137690.165315:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:3.0:1783137690.165846:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13743:x1869754974447872:12345-192.168.203.36@tcp:41:mount.lustre.0 Request processed in 908us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137690.165855:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:1.0:1783137690.168680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137690.168764:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974448000 00000100:00100000:0.0:1783137690.168773:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974448000 00000100:00100000:0.0:1783137690.168845:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:0.0:1783137690.168855:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13743:x1869754974448000:12345-192.168.203.36@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783137690.168927:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13743:x1869754974448000:12345-192.168.203.36@tcp:40:mount.lustre.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137690.168934:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00080000:2.0:1783137690.171742:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137690.172124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137690.172161:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137690.172411:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974448128 00000100:00100000:2.0:1783137690.172419:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974448128 00000100:00100000:2.0:1783137690.172450:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974448256 00000100:00100000:2.0:1783137690.172453:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974448256 00000100:00100000:2.0:1783137690.172469:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:2.0:1783137690.172476:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1869754974448128:12345-192.168.203.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783137690.172511:0:14915:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from dbff8b30-85ae-47b7-8614-cc3f77566a29@192.168.203.36@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1783137690.172540:0:14915:0:(genops.c:1406:class_connect()) connect: client dbff8b30-85ae-47b7-8614-cc3f77566a29, cookie 0x88def104ac675d24 00002000:00100000:2.0:1783137690.172551:0:14915:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dbff8b30-85ae-47b7-8614-cc3f77566a29/ffff970983033000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783137690.172573:0:14915:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783137690.172912:0:14915:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783137690.172941:0:14915:0:(import.c:65:import_set_state_nolock()) ffff970983036800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783137690.173009:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:2350:x1869754974448128:12345-192.168.203.36@tcp:8:mount.lustre.0 Request processed in 532us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137690.173029:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:2.0:1783137690.173049:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:2.0:1783137690.173053:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1869754974448256:12345-192.168.203.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783137690.173069:0:14915:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from dbff8b30-85ae-47b7-8614-cc3f77566a29@192.168.203.36@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1783137690.173085:0:14915:0:(genops.c:1406:class_connect()) connect: client dbff8b30-85ae-47b7-8614-cc3f77566a29, cookie 0x88def104ac675d2b 00002000:00100000:2.0:1783137690.173091:0:14915:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dbff8b30-85ae-47b7-8614-cc3f77566a29/ffff970983037000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783137690.173104:0:14915:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783137690.173520:0:14915:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783137690.173535:0:14915:0:(import.c:65:import_set_state_nolock()) ffff970983034000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783137690.173560:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:2350:x1869754974448256:12345-192.168.203.36@tcp:8:mount.lustre.0 Request processed in 505us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137690.173567:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:1.0:1783137690.177300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137690.177409:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974448384 00000100:00100000:2.0:1783137690.177419:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974448384 00000100:00100000:2.0:1783137690.177468:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:2.0:1783137690.177478:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13743:x1869754974448384:12345-192.168.203.36@tcp:33:mount.lustre.0 00000004:00080000:0.0:1783137690.186076:0:14269:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8472us 00000004:00200000:2.0:1783137690.212596:0:14269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1783137690.212830:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13743:x1869754974448384:12345-192.168.203.36@tcp:33:mount.lustre.0 Request processed in 35348us (35541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137690.212840:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:1.0:1783137690.377417:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137690.377514:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974448512 00000100:00100000:3.0:1783137690.377524:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974448512 00000100:00100000:3.0:1783137690.377582:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:3.0:1783137690.377592:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13786:x1869754974448512:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:3.0:1783137690.377610:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137690.377636:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff970980030c00/0x88def104ac675d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72bdb expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.377973:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff970980031800/0x88def104ac675d39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.377988:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff970980031800/0x88def104ac675d39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.378019:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff970980031800/0x88def104ac675d39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783137690.378250:0:14268:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783137690.378254:0:14268:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783137690.378366:0:14268:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff970980031800/0x88def104ac675d39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.378392:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff970980030c00/0x88def104ac675d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bdb expref: 8 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.378408:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff970980031800/0x88def104ac675d39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bdb expref: 7 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137690.378418:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987fc4900) 00010000:00010000:3.0:1783137690.378421:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783137690.378425:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980031800, rc 0) 00000100:00100000:3.0:1783137690.378489:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:13786:x1869754974448512:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 899us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137690.378497:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00010000:00010000:0.0:1783137690.663070:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137691.559036:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990169344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137691.559106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137691.559450:0:14919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990169344 00000100:00100000:1.0:1783137691.559458:0:14919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990169344 00000100:00080000:2.0:1783137691.559566:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783137691.559613:0:14919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783137691.559623:0:14919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990169344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137691.559646:0:14919:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137691.559702:0:14919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869754990169344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137691.559709:0:14919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783137691.559763:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1869754990169344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783137691.687183:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137692.316943:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137692.317147:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974448640 00000100:00100000:1.0:1783137692.317157:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974448640 00000100:00100000:1.0:1783137692.317234:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:1.0:1783137692.317253:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:13839:x1869754974448640:12345-192.168.203.36@tcp:41:lfs.0 00000004:00000024:1.0:1783137692.317308:0:14266:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783137692.317409:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:13839:x1869754974448640:12345-192.168.203.36@tcp:41:lfs.0 Request processed in 161us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137692.317417:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00080000:2.0:1783137692.320163:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137692.320825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137692.321029:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974448768 00000100:00100000:0.0:1783137692.321039:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974448768 00000100:00100000:0.0:1783137692.321291:0:14918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:0.0:1783137692.321302:0:14918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13839:x1869754974448768:12345-192.168.203.36@tcp:13:lfs.0 00002000:00000024:0.0:1783137692.321339:0:14918:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137692.321420:0:14918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13839:x1869754974448768:12345-192.168.203.36@tcp:13:lfs.0 Request processed in 120us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137692.321427:0:14918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00080000:2.0:1783137692.322007:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137692.323313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137692.323375:0:14919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974448896 00000100:00100000:1.0:1783137692.323383:0:14919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974448896 00000100:00100000:1.0:1783137692.323447:0:14919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:1.0:1783137692.323459:0:14919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13839:x1869754974448896:12345-192.168.203.36@tcp:13:lfs.0 00002000:00000024:1.0:1783137692.323489:0:14919:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137692.323565:0:14919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:13839:x1869754974448896:12345-192.168.203.36@tcp:13:lfs.0 Request processed in 108us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137692.323572:0:14919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00080000:2.0:1783137692.323697:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137692.482539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137692.482617:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974449024 00000100:00100000:2.0:1783137692.482627:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974449024 00000100:00100000:2.0:1783137692.482685:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:2.0:1783137692.482695:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+10:13868:x1869754974449024:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783137692.482710:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137692.482727:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709b26e6e00/0x88def104ac675d40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72be2 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.482755:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709b26e6e00/0x88def104ac675d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72be2 expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.482766:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709b26e6e00/0x88def104ac675d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72be2 expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.482775:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e6e00, rc 0) 00000100:00100000:2.0:1783137692.482863:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13868:x1869754974449024:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 169us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137692.482871:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 91 00000100:00100000:3.0:1783137692.494344:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137692.494417:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974449152 00000100:00100000:2.0:1783137692.494427:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974449152 00000100:00100000:2.0:1783137692.494531:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:2.0:1783137692.494541:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13868:x1869754974449152:12345-192.168.203.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783137692.495031:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13868:x1869754974449152:12345-192.168.203.36@tcp:501:mount.lustre.0 Request processed in 490us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137692.495040:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 92 00000100:00100000:1.0:1783137692.499053:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137692.499127:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974449280 00000100:00100000:0.0:1783137692.499146:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974449280 00000100:00100000:0.0:1783137692.499197:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:0.0:1783137692.499207:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13868:x1869754974449280:12345-192.168.203.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783137692.499462:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13868:x1869754974449280:12345-192.168.203.36@tcp:503:mount.lustre.0 Request processed in 255us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137692.499470:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 93 00000100:00100000:1.0:1783137692.504214:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137692.504378:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974449408 00000100:00100000:0.0:1783137692.504388:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974449408 00000100:00100000:0.0:1783137692.504435:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:0.0:1783137692.504445:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13876:x1869754974449408:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137692.504727:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13876:x1869754974449408:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 282us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137692.504735:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 94 00000100:00100000:1.0:1783137692.517663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137692.517878:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974449536 00000100:00100000:0.0:1783137692.517888:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974449536 00000100:00100000:0.0:1783137692.517945:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:0.0:1783137692.517955:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13876:x1869754974449536:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137692.518215:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13876:x1869754974449536:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 261us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137692.518223:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 95 00000100:00100000:1.0:1783137692.530388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137692.532284:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974449664 00000100:00100000:2.0:1783137692.532298:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974449664 00000100:00100000:2.0:1783137692.532366:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:2.0:1783137692.532377:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13868:x1869754974449664:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783137692.532393:0:14260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137692.532412:0:14260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709b26e6200/0x88def104ac675d47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c0c expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.532439:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709b26e6200/0x88def104ac675d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c0c expref: 12 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.532450:0:14260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709b26e6200/0x88def104ac675d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c0c expref: 12 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.532458:0:14260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e6200, rc 0) 00000100:00100000:2.0:1783137692.532525:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13868:x1869754974449664:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 148us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137692.532533:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 96 00000100:00100000:1.0:1783137692.550196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137692.552199:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974449792 00000100:00100000:3.0:1783137692.552213:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974449792 00000100:00100000:3.0:1783137692.552320:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:3.0:1783137692.552331:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13868:x1869754974449792:12345-192.168.203.36@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783137692.552357:0:14259:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783137692.552375:0:14259:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783137692.552379:0:14259:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783137692.552383:0:14259:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783137692.552385:0:14259:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1783137692.554442:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13868:x1869754974449792:12345-192.168.203.36@tcp:256:mount.lustre.0 Request processed in 2103us (4245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137692.554456:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 97 00000100:00100000:1.0:1783137692.568836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137692.571078:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974449920 00000100:00100000:2.0:1783137692.571091:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974449920 00000100:00100000:2.0:1783137692.571168:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:2.0:1783137692.571179:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13868:x1869754974449920:12345-192.168.203.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783137692.571195:0:14260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137692.571213:0:14260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c13 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.571248:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c13 expref: 13 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.571287:0:14260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c13 expref: 13 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.571296:0:14260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e6800, rc 0) 00000100:00100000:2.0:1783137692.571359:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13868:x1869754974449920:12345-192.168.203.36@tcp:101:mount.lustre.0 Request processed in 182us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137692.571366:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 98 00000100:00100000:1.0:1783137692.581904:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137692.581957:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974450048 00000100:00100000:3.0:1783137692.581968:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974450048 00000100:00100000:3.0:1783137692.582024:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:3.0:1783137692.582035:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13868:x1869754974450048:12345-192.168.203.36@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783137692.582308:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13868:x1869754974450048:12345-192.168.203.36@tcp:501:mount.lustre.0 Request processed in 274us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137692.582316:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 99 00000100:00100000:0.0:1783137692.588551:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990169472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137692.588621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137692.588699:0:14919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990169472 00000100:00100000:0.0:1783137692.588706:0:14919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990169472 00000100:00100000:1.0:1783137692.588751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:3.0:1783137692.588755:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137692.588758:0:14919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137692.588767:0:14919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990169472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783137692.588811:0:14919:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783137692.588853:0:14919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990169472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137692.588860:0:14919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783137692.588884:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1783137692.588908:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990169472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137692.589066:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974450176 00000100:00100000:2.0:1783137692.589070:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974450176 00000100:00100000:2.0:1783137692.589104:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:2.0:1783137692.589113:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13868:x1869754974450176:12345-192.168.203.36@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783137692.589224:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990169856:0@lo:400:kworker.0 00000100:00100000:2.0:1783137692.589302:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13868:x1869754974450176:12345-192.168.203.36@tcp:503:mount.lustre.0 Request processed in 189us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137692.589309:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 100 00000100:00100000:3.0:1783137692.589330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137692.589350:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137692.589356:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990169984:0@lo:400:kworker.0 00000100:00100000:3.0:1783137692.589376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137692.589403:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990169856 00000100:00100000:3.0:1783137692.589412:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990169856 00000100:00100000:3.0:1783137692.589436:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990169984 00000100:00100000:3.0:1783137692.589439:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990169984 00000100:00100000:3.0:1783137692.589462:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137692.589468:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990169856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137692.589485:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783137692.589490:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990169984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137692.589501:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869754990169856:12345-0@lo:400:kworker.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137692.589507:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783137692.589517:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869754990169984:12345-0@lo:400:kworker.0 Request processed in 27us (141us total) trans 0 rc 0/0 00000100:00080000:3.0:1783137692.589521:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137692.589536:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137692.589538:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1869754990169984:0@lo:400:kworker.0 00000100:00100000:3.0:1783137692.589548:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869754990169856:0@lo:400:kworker.0 00000100:00100000:0.0:1783137692.590204:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990169600:0@lo:400:kworker.0 00000100:00100000:0.0:1783137692.590242:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137692.590289:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990170112:0@lo:400:kworker.0 00000100:00100000:0.0:1783137692.590313:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137692.590332:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137692.590338:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990169728:0@lo:400:kworker.0 00000100:00100000:0.0:1783137692.590361:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137692.590391:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990169728 00000100:00100000:0.0:1783137692.590396:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990169728 00000100:00100000:0.0:1783137692.590431:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137692.590436:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990169728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137692.590474:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990169728:12345-0@lo:400:kworker.0 Request processed in 38us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137692.590492:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783137692.590509:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990170112 00000100:00100000:0.0:1783137692.590511:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990170112 00000100:00100000:0.0:1783137692.590549:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137692.590556:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990170112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137692.590592:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869754990170112:12345-0@lo:400:kworker.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137692.590598:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783137692.590622:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137692.590629:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990169728:0@lo:400:kworker.0 00000100:00100000:0.0:1783137692.590641:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1869754990170112:0@lo:400:kworker.0 00000100:00100000:2.0:1783137692.590879:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990169600 00000100:00100000:2.0:1783137692.590883:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990169600 00000100:00100000:2.0:1783137692.590908:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783137692.590913:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3308:x1869754990169600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137692.590947:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3308:x1869754990169600:12345-0@lo:400:kworker.0 Request processed in 34us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137692.590962:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783137692.591025:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990169600:0@lo:400:kworker.0 00000100:00100000:1.0:1783137692.593433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137692.593689:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974450304 00000100:00100000:3.0:1783137692.593697:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974450304 00000100:00100000:3.0:1783137692.593847:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:3.0:1783137692.593858:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13882:x1869754974450304:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783137692.594101:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13882:x1869754974450304:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 244us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137692.594109:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 102 00000100:00100000:2.0:1783137692.598453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137692.598701:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974450432 00000100:00100000:0.0:1783137692.598712:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974450432 00000100:00100000:0.0:1783137692.598980:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:0.0:1783137692.598992:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13882:x1869754974450432:12345-192.168.203.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783137692.599398:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13882:x1869754974450432:12345-192.168.203.36@tcp:502:llog_process_th.0 Request processed in 406us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137692.599408:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 103 00000100:00100000:1.0:1783137692.607161:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137692.609668:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974450560 00000100:00100000:2.0:1783137692.609682:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974450560 00000100:00100000:2.0:1783137692.609750:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:2.0:1783137692.609759:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1869754974450560:12345-192.168.203.36@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783137692.609834:0:14266:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 57e4b930-3497-4532-8753-869c6eeffd65@192.168.203.36@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1783137692.609883:0:14266:0:(genops.c:1406:class_connect()) connect: client 57e4b930-3497-4532-8753-869c6eeffd65, cookie 0x88def104ac675d55 00000004:00100000:2.0:1783137692.609914:0:14266:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783137692.610256:0:14266:0:(import.c:65:import_set_state_nolock()) ffff970983037800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783137692.610333:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57e4b930-3497-4532-8753-869c6eeffd65+6:2350:x1869754974450560:12345-192.168.203.36@tcp:38:mount.lustre.0 Request processed in 575us (3182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137692.610343:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1783137692.614168:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137692.614210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137692.614303:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974450688 00000100:00100000:3.0:1783137692.614316:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974450688 00000100:00100000:3.0:1783137692.614383:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974450816 00000100:00100000:3.0:1783137692.614386:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974450816 00000100:00100000:3.0:1783137692.614407:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:3.0:1783137692.614415:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57e4b930-3497-4532-8753-869c6eeffd65+7:0:x1869754974450688:12345-192.168.203.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783137692.614447:0:15443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783137692.614520:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57e4b930-3497-4532-8753-869c6eeffd65+7:0:x1869754974450688:12345-192.168.203.36@tcp:41:mount.lustre.0 Request processed in 104us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137692.614539:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:3.0:1783137692.614556:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:3.0:1783137692.614562:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57e4b930-3497-4532-8753-869c6eeffd65+6:13868:x1869754974450816:12345-192.168.203.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783137692.614573:0:15443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783137692.614595:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57e4b930-3497-4532-8753-869c6eeffd65+6:13868:x1869754974450816:12345-192.168.203.36@tcp:41:mount.lustre.0 Request processed in 33us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137692.614601:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00080000:0.0:1783137692.615332:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137692.622993:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137692.623128:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974450944 00000100:00100000:3.0:1783137692.623138:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974450944 00000100:00100000:3.0:1783137692.623190:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:3.0:1783137692.623200:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57e4b930-3497-4532-8753-869c6eeffd65+6:13868:x1869754974450944:12345-192.168.203.36@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783137692.623291:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57e4b930-3497-4532-8753-869c6eeffd65+6:13868:x1869754974450944:12345-192.168.203.36@tcp:40:mount.lustre.0 Request processed in 92us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137692.623299:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:1.0:1783137692.626256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137692.626299:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137692.626329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137692.626394:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974451072 00000100:00100000:3.0:1783137692.626403:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974451072 00000100:00100000:3.0:1783137692.626438:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974451200 00000100:00100000:3.0:1783137692.626441:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974451200 00000100:00100000:3.0:1783137692.626454:0:14917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:3.0:1783137692.626473:0:14917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1869754974451072:12345-192.168.203.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783137692.626511:0:14917:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 57e4b930-3497-4532-8753-869c6eeffd65@192.168.203.36@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1783137692.626543:0:14917:0:(genops.c:1406:class_connect()) connect: client 57e4b930-3497-4532-8753-869c6eeffd65, cookie 0x88def104ac675d5c 00002000:00100000:3.0:1783137692.626553:0:14917:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 57e4b930-3497-4532-8753-869c6eeffd65/ffff970883a6f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783137692.626564:0:14917:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783137692.626684:0:14917:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783137692.626711:0:14917:0:(import.c:65:import_set_state_nolock()) ffff970883a6c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137692.626778:0:14917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57e4b930-3497-4532-8753-869c6eeffd65+6:2350:x1869754974451072:12345-192.168.203.36@tcp:8:mount.lustre.0 Request processed in 314us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137692.626786:0:14917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:3.0:1783137692.627048:0:14917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:3.0:1783137692.627054:0:14917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1869754974451200:12345-192.168.203.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783137692.627071:0:14917:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 57e4b930-3497-4532-8753-869c6eeffd65@192.168.203.36@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1783137692.627090:0:14917:0:(genops.c:1406:class_connect()) connect: client 57e4b930-3497-4532-8753-869c6eeffd65, cookie 0x88def104ac675d63 00002000:00100000:3.0:1783137692.627096:0:14917:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 57e4b930-3497-4532-8753-869c6eeffd65/ffff970883a6f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783137692.627102:0:14917:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783137692.627158:0:14917:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783137692.627173:0:14917:0:(import.c:65:import_set_state_nolock()) ffff970883a6e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783137692.627198:0:14917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57e4b930-3497-4532-8753-869c6eeffd65+6:2350:x1869754974451200:12345-192.168.203.36@tcp:8:mount.lustre.0 Request processed in 143us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137692.627205:0:14917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:2.0:1783137692.628224:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974451328 00000100:00100000:2.0:1783137692.628233:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974451328 00000100:00100000:2.0:1783137692.628283:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:2.0:1783137692.628292:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57e4b930-3497-4532-8753-869c6eeffd65+6:13868:x1869754974451328:12345-192.168.203.36@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783137692.628530:0:14270:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1783137692.628666:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57e4b930-3497-4532-8753-869c6eeffd65+6:13868:x1869754974451328:12345-192.168.203.36@tcp:33:mount.lustre.0 Request processed in 374us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137692.628674:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1 00010000:00010000:0.0:1783137692.711522:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137692.821881:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137692.822192:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974451456 00000100:00100000:2.0:1783137692.822202:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974451456 00000100:00100000:2.0:1783137692.822275:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:2.0:1783137692.822285:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57e4b930-3497-4532-8753-869c6eeffd65+6:13903:x1869754974451456:12345-192.168.203.36@tcp:101:mkdir.0 00010000:00010000:2.0:1783137692.822322:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137692.822343:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7e00/0x88def104ac675d6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c3d expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.822401:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.822415:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.822427:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137692.822645:0:14268:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783137692.822650:0:14268:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137692.822729:0:14268:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.822758:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7e00/0x88def104ac675d6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c3d expref: 8 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.822841:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c3d expref: 7 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137692.822850:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987fc4900) 00010000:00010000:2.0:1783137692.822853:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137692.822857:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e6000, rc 0) 00000100:00100000:2.0:1783137692.823275:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57e4b930-3497-4532-8753-869c6eeffd65+7:13903:x1869754974451456:12345-192.168.203.36@tcp:101:mkdir.0 Request processed in 981us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137692.823284:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000001:00100000:3.0:1783137693.151937:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dbff8b30-85ae-47b7-8614-cc3f77566a29 00000001:00100000:3.0:1783137693.151951:0:7535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 57e4b930-3497-4532-8753-869c6eeffd65 00010000:00010000:0.0:1783137693.739258:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783137694.715969:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dbff8b30-85ae-47b7-8614-cc3f77566a29 00000001:00100000:1.0:1783137694.716183:0:6644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 57e4b930-3497-4532-8753-869c6eeffd65 00010000:00010000:0.0:1783137694.759771:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783137695.223574:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 57e4b930-3497-4532-8753-869c6eeffd65 00000001:00100000:0.0:1783137695.223600:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dbff8b30-85ae-47b7-8614-cc3f77566a29 00000001:02000400:2.0:1783137695.586217:0:16148:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783137695.784636:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137696.683198:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783137696.683236:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990170240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137696.683327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137696.683409:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990170240 00000100:00100000:1.0:1783137696.683416:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990170240 00000100:00100000:1.0:1783137696.683465:0:14918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783137696.683472:0:14918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990170240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137696.683522:0:14918:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137696.683631:0:14918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990170240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137696.683666:0:14918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783137696.683737:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990170240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783137696.685184:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783137696.811518:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137697.703103:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990170624:0@lo:400:kworker.0 00000100:00100000:2.0:1783137697.703184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137697.703249:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137697.703256:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990170752:0@lo:400:kworker.0 00000100:00100000:2.0:1783137697.703282:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137697.703316:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990170624 00000100:00100000:2.0:1783137697.703323:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990170624 00000100:00100000:2.0:1783137697.703373:0:14917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137697.703382:0:14917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990170624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137697.703432:0:14917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990170624:12345-0@lo:400:kworker.0 Request processed in 51us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137697.703439:0:14917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783137697.703473:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990170752 00000100:00100000:2.0:1783137697.703478:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990170752 00000100:00100000:2.0:1783137697.703503:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783137697.703509:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990170752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137697.703537:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990170752:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137697.703543:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783137697.703826:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990170496:0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.703868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137697.703895:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990171008:0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.703915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137697.703933:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783137697.703939:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3307:1869754990170368:0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.704068:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137697.704091:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990170880:0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.704115:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137697.704142:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990170496 00000100:00100000:1.0:1783137697.704516:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990170496 00000100:00100000:1.0:1783137697.704620:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783137697.704629:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990170496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.704675:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990170496:12345-0@lo:400:kworker.0 Request processed in 48us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137697.704682:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783137697.704705:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990171008 00000100:00100000:1.0:1783137697.704708:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990171008 00000100:00100000:1.0:1783137697.704725:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990170880 00000100:00100000:1.0:1783137697.704728:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990170880 00000100:00100000:1.0:1783137697.704739:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783137697.704744:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990171008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.704816:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990171008:12345-0@lo:400:kworker.0 Request processed in 47us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137697.704823:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783137697.704836:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783137697.704841:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990170880:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783137697.705129:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783137697.705133:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783137697.705351:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990170368 00000100:00100000:3.0:1783137697.705357:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990170368 00000100:00100000:3.0:1783137697.705393:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783137697.705402:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3307:x1869754990170368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137697.705446:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3307:x1869754990170368:12345-0@lo:400:kworker.0 Request processed in 46us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137697.705453:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783137697.705546:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990170752:0@lo:400:kworker.0 00000100:00100000:2.0:1783137697.705624:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990170624:0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.705694:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990170880:12345-0@lo:400:kworker.0 Request processed in 852us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137697.705700:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783137697.705727:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3307:1869754990170368:0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.705737:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990170880:0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.705747:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990170496:0@lo:400:kworker.0 00000100:00100000:1.0:1783137697.705756:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990171008:0@lo:400:kworker.0 00000100:00100000:3.0:1783137697.705991:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137697.706002:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990171136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137697.706035:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137697.706227:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990171136 00000100:00100000:1.0:1783137697.706241:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990171136 00000100:00100000:1.0:1783137697.706278:0:14918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783137697.706285:0:14918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990171136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137697.706312:0:14918:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137697.706349:0:14918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990171136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137697.706356:0:14918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783137697.706381:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990171136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783137697.834498:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137698.111611:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137698.111654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137698.111701:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974451712 00000100:00100000:3.0:1783137698.111710:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974451712 00000100:00100000:3.0:1783137698.111764:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1783137698.111775:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:2353:x1869754974451712:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137698.111888:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:2353:x1869754974451712:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 114us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137698.111896:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00080000:3.0:1783137698.111929:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137698.113038:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974451584 00000100:00100000:1.0:1783137698.113047:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974451584 00000100:00100000:1.0:1783137698.113086:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 105 00000100:00100000:1.0:1783137698.113094:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+13:2353:x1869754974451584:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137698.113151:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+13:2353:x1869754974451584:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 58us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137698.113159:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 105 00000100:00100000:3.0:1783137698.121428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137698.121467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137698.121497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137698.121525:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137698.121537:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974451968 00000100:00100000:0.0:1783137698.121548:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974451968 00000100:00100000:3.0:1783137698.121552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00080000:3.0:1783137698.121578:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137698.121613:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974452224 00000100:00100000:0.0:1783137698.121618:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974452224 00000100:00100000:1.0:1783137698.121620:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974451840 00000100:00100000:1.0:1783137698.121626:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974451840 00000100:00100000:1.0:1783137698.121665:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:0.0:1783137698.121665:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974452352 00000100:00100000:0.0:1783137698.121670:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974452352 00000100:00100000:1.0:1783137698.121679:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2354:x1869754974451968:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137698.121694:0:14915:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783137698.121703:0:14915:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1783137698.121753:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2354:x1869754974451968:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 77us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137698.121762:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:1.0:1783137698.121813:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:1.0:1783137698.121822:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57e4b930-3497-4532-8753-869c6eeffd65+5:2354:x1869754974452224:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137698.121849:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:0.0:1783137698.121859:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2354:x1869754974451840:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137698.121864:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57e4b930-3497-4532-8753-869c6eeffd65+5:2354:x1869754974452224:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 42us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137698.121874:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:1.0:1783137698.121886:0:14916:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783137698.121893:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:0.0:1783137698.121902:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2354:x1869754974451840:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 43us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137698.121903:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57e4b930-3497-4532-8753-869c6eeffd65+5:2354:x1869754974452352:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137698.121918:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:1.0:1783137698.121939:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57e4b930-3497-4532-8753-869c6eeffd65+5:2354:x1869754974452352:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 38us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137698.121947:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:0.0:1783137698.122193:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974452096 00000100:00080000:3.0:1783137698.122195:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783137698.122199:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974452096 00000100:00080000:3.0:1783137698.122200:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137698.122270:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137698.122272:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1783137698.122282:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57e4b930-3497-4532-8753-869c6eeffd65+6:2354:x1869754974452096:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137698.122326:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57e4b930-3497-4532-8753-869c6eeffd65+6:2354:x1869754974452096:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 45us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137698.122332:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000040:00080000:3.0:1783137698.154743:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1783137698.779644:0:16296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb105c2a0 20000000:00000080:0.0:1783137698.779660:0:16296:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9709a551ec00 uarg=0000000000000000 20000000:01000000:0.0:1783137698.779695:0:16296:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783137698.779701:0:16296:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783137698.779710:0:16296:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783137698.787076:0:16297:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1783137698.787404:0:16296:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783137698.795383:0:16296:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783137698.795491:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795510:0:16296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675a68 expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795518:0:16296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675ab5 expref: 18 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795526:0:16296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675be9 expref: 18 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795536:0:16296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bb1 expref: 12 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795543:0:16296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c13 expref: 12 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795551:0:16296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795595:0:16296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c13 expref: 12 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795611:0:16296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c13 expref: 12 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137698.795624:0:16296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171264:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137698.795777:0:16296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bb1 expref: 12 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795830:0:16296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bb1 expref: 12 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137698.795840:0:16296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171392:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137698.795883:0:16296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac675be9 expref: 18 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.795891:0:16296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac675be9 expref: 18 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137698.795901:0:16296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171520:0@lo:104: 00000100:00100000:0.0:1783137698.795940:0:16296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783137698.796025:0:16296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac675ab5 expref: 18 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.796033:0:16296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac675ab5 expref: 18 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137698.796472:0:16296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc35c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171648:0@lo:104: 00000100:00100000:0.0:1783137698.796502:0:16296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783137698.796545:0:16296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88def104ac675a68 expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137698.796553:0:16296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88def104ac675a68 expref: 18 pid: 14259 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137698.796560:0:16296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171776:0@lo:104: 00000100:00100000:2.0:1783137698.796583:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990171520 00000100:00100000:0.0:1783137698.796589:0:16296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137698.796593:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990171520 00000100:00100000:0.0:1783137698.796614:0:16296:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ce7d300 going to sleep for 11 seconds 00000100:00100000:2.0:1783137698.796642:0:14250:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783137698.796659:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990171648 00000100:00100000:2.0:1783137698.796663:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990171648 00000100:00100000:2.0:1783137698.796679:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990171776 00000100:00100000:2.0:1783137698.796682:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990171776 00000100:00100000:2.0:1783137698.796697:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137698.796705:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc35e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+5:16296:x1869754990171520:12345-0@lo:104: 00010000:00010000:2.0:1783137698.796717:0:14250:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.796776:0:14250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783137698.796784:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc35e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+5:16296:x1869754990171520:12345-0@lo:104: Request processed in 79us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137698.796815:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137698.796838:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783137698.796845:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+4:16296:x1869754990171648:12345-0@lo:104: 00010000:00010000:2.0:1783137698.796853:0:14250:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.797496:0:14250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783137698.797506:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+4:16296:x1869754990171648:12345-0@lo:104: Request processed in 660us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137698.797516:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783137698.797533:0:16296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171520:0@lo:104: 00000100:00100000:2.0:1783137698.797541:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137698.797548:0:16296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171648:0@lo:104: 00000100:00100000:2.0:1783137698.797553:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709be131450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:16296:x1869754990171776:12345-0@lo:104: 00010000:00010000:2.0:1783137698.797565:0:14250:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.797610:0:14250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783137698.797624:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709be131450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+3:16296:x1869754990171776:12345-0@lo:104: Request processed in 76us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137698.797630:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783137698.797657:0:16296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171776:0@lo:104: 00010000:00010000:1.0:1783137698.797744:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137698.797754:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783137698.797757:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137698.797766:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c400 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:1.0:1783137698.797770:0:14255:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137698.797779:0:14255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137698.797786:0:14255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137698.797848:0:14255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783137698.797881:0:14255:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137698.797888:0:14255:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137698.797918:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137698.797925:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709afd0c400/0x88def104ac675ab5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675abc expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137698.797938:0:14255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1783137698.797940:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1783137698.797942:0:14255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137698.797949:0:14255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235800 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:1.0:1783137698.797952:0:14255:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137698.797954:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990171904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783137698.797972:0:14255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783137698.797979:0:14255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783137698.797986:0:14255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1783137698.797993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783137698.798008:0:14255:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137698.798015:0:14255:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783137698.798031:0:14255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137698.798037:0:14255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd235800/0x88def104ac675a68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675a6f expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137698.798039:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990171904 00000100:00100000:2.0:1783137698.798045:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990171904 00010000:00010000:2.0:1783137698.798065:0:14252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675ab5 expref: 19 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137698.798089:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137698.798095:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3308:x1869754990171904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137698.798104:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137698.798109:0:14252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675ab5 expref: 19 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.798117:0:14252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac675ab5 expref: 19 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.798132:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd050600/0x88def104ac675abc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac675ab5 expref: 19 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.798145:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137698.798174:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:3308:x1869754990171904:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137698.798180:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783137698.798216:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3308:1869754990171904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137698.798298:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990172032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137698.798329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137698.798446:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990172032 00000100:00100000:2.0:1783137698.798461:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990172032 00010000:00010000:2.0:1783137698.798477:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675a68 expref: 18 pid: 14259 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137698.798503:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783137698.798510:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:3306:x1869754990172032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137698.798519:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137698.798524:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675a68 expref: 18 pid: 14259 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.798530:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac675a68 expref: 18 pid: 14259 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.798540:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd004600/0x88def104ac675a6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac675a68 expref: 18 pid: 14259 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.798548:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137698.798577:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:3306:x1869754990172032:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137698.798583:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783137698.798607:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990172032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137698.798683:0:16298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137698.798691:0:16298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137698.798693:0:16298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137698.798733:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137698.798734:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137698.798736:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137698.799256:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.799265:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd005e00 already unused, calling callback (ffffffffc1af7c20) 10000000:00010000:2.0:1783137698.799269:0:14254:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.799287:0:14254:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137698.799293:0:14254:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137698.799298:0:14254:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783137698.799361:0:14254:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.799368:0:14254:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137698.799388:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.799394:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.136@tcp lock: ffff9709bd005e00/0x88def104ac675be9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88def104ac675bf0 expref: -99 pid: 15583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.799407:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137698.799409:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137698.799410:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137698.801427:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137698.801452:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990172160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137698.801505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137698.801618:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990172160 00000100:00100000:2.0:1783137698.801625:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990172160 00010000:00010000:2.0:1783137698.801658:0:14253:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675be9 expref: 17 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137698.801686:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137698.801693:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709c19e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:3306:x1869754990172160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783137698.801706:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137698.801711:0:14253:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88def104ac675be9 expref: 17 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.801735:0:14253:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88def104ac675be9 expref: 17 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.801763:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709afd0cc00/0x88def104ac675bf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88def104ac675be9 expref: 17 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.801778:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137698.801831:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709c19e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:3306:x1869754990172160:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137698.801837:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783137698.801898:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3306:1869754990172160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137698.803280:0:16296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171264:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137698.803294:0:16296:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc35c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16296:1869754990171392:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137698.803322:0:16296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137698.807577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137698.807651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137698.807766:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974452480 00000100:00100000:2.0:1783137698.807776:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974452480 00010000:00010000:2.0:1783137698.807840:0:14253:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c13 expref: 13 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137698.807873:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974452608 00000100:00100000:2.0:1783137698.807880:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974452608 00010000:00010000:2.0:1783137698.807893:0:14253:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bb1 expref: 14 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137698.807909:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:2.0:1783137698.807917:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e12153bb-60a1-4b82-8c05-faed68451b0d+14:2352:x1869754974452480:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137698.807945:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137698.807952:0:14253:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c13 expref: 14 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.807965:0:14253:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c13 expref: 14 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.807982:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709b26e6800/0x88def104ac675d4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c13 expref: 14 pid: 14260 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.807997:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137698.808046:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e12153bb-60a1-4b82-8c05-faed68451b0d+13:2352:x1869754974452480:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 128us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137698.808053:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:2.0:1783137698.808072:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:2.0:1783137698.808078:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e12153bb-60a1-4b82-8c05-faed68451b0d+12:2351:x1869754974452608:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137698.808086:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137698.808091:0:14253:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bb1 expref: 12 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808100:0:14253:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bb1 expref: 12 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808110:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff970980030a00/0x88def104ac675d16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bb1 expref: 12 pid: 14261 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808122:0:14253:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808141:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808156:0:14253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808162:0:14253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808169:0:14253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808175:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808180:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234200 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137698.808184:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808190:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808206:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808214:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137698.808243:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e12153bb-60a1-4b82-8c05-faed68451b0d+11:2351:x1869754974452608:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 165us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137698.808249:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00010000:00010000:2.0:1783137698.808273:0:16296:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808286:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137698.808291:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9709bd234200/0x88def104ac675d78 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137698.855288:0:16298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783137699.880346:0:14263:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783137699.880353:0:14263:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709b7c85800 from 10 10000000:01000000:3.0:1783137699.880358:0:14263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783137699.880398:0:14263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac675d7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137699.880410:0:14263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac675d7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137699.880420:0:14263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac675d7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137699.880444:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bca7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783137699.880507:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137699.880551:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709879eb900 going to sleep for 11 seconds 00000100:00100000:3.0:1783137699.880571:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990172288 00000100:00100000:3.0:1783137699.880578:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990172288 00000100:00100000:3.0:1783137699.880625:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783137699.880634:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+16:14263:x1869754990172288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137699.880647:0:14261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137699.880649:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137699.880661:0:14261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980030c00/0x88def104ac675d86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675d7f expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137699.880693:0:14261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980030c00/0x88def104ac675d86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675d7f expref: 17 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137699.880703:0:14261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980030c00/0x88def104ac675d86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675d7f expref: 17 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137699.880711:0:14261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980030c00, rc 0) 00000100:00100000:3.0:1783137699.880853:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:14263:x1869754990172288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137699.880861:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783137699.880879:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bca7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137699.880898:0:14263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac675d7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675d86 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.880910:0:14263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac675d7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675d86 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137699.881084:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.881115:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137699.881150:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137699.881270:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990172416 00000100:00100000:3.0:1783137699.881275:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990172416 00000100:00100000:3.0:1783137699.881308:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783137699.881315:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:14263:x1869754990172416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137699.881699:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:14263:x1869754990172416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137699.881706:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783137699.882163:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.882198:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.882249:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137699.882290:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990172544 00000100:00100000:3.0:1783137699.882296:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990172544 00000100:00100000:3.0:1783137699.882325:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783137699.882335:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:14263:x1869754990172544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.882345:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137699.882642:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:14263:x1869754990172544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 309us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137699.882649:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783137699.882850:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783137699.883767:0:16336:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783137699.883842:0:14263:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783137699.883865:0:14263:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137699.883875:0:14263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac675d7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675d86 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.883885:0:14263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff970980031000/0x88def104ac675d7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675d86 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137699.883902:0:14263:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783137699.883905:0:14263:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97098b126800 from 10 10000000:01000000:0.0:1783137699.883907:0:14263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783137699.883935:0:14263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd235600/0x88def104ac675d8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.884177:0:14263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd235600/0x88def104ac675d8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.884187:0:14263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd235600/0x88def104ac675d8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137699.884207:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.884372:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137699.884409:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137699.884455:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990172672 00000100:00100000:3.0:1783137699.884466:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990172672 00000100:00100000:3.0:1783137699.884579:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783137699.884586:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+17:14263:x1869754990172672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137699.884597:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137699.884606:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980031c00/0x88def104ac675d94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675d8d expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137699.884626:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980031c00/0x88def104ac675d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675d8d expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137699.884635:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980031c00/0x88def104ac675d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675d8d expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137699.884643:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980031c00, rc 0) 00000100:00100000:3.0:1783137699.884681:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:14263:x1869754990172672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137699.884687:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783137699.884753:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137699.884766:0:14263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd235600/0x88def104ac675d8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675d94 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.884774:0:14263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd235600/0x88def104ac675d8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675d94 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137699.884898:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.884929:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137699.885089:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783137699.885208:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990172800 00000100:00100000:3.0:1783137699.885213:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990172800 00000100:00100000:3.0:1783137699.885317:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783137699.885329:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:14263:x1869754990172800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137699.889732:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:14263:x1869754990172800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4396us (4792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137699.889746:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783137699.894168:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137699.894244:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783137699.894537:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137699.894585:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ceb5780 going to sleep for 11 seconds 00000100:00100000:0.0:1783137699.894686:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990172928 00000100:00100000:0.0:1783137699.894693:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990172928 00000100:00100000:0.0:1783137699.894760:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783137699.894770:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:14263:x1869754990172928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.895451:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:14263:x1869754990172928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 680us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137699.895460:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783137699.895679:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990172928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783137699.896900:0:16339:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783137699.897135:0:14263:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783137699.897229:0:14263:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137699.897242:0:14263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd235600/0x88def104ac675d8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675d94 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.897254:0:14263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd235600/0x88def104ac675d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675d94 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137699.897327:0:14263:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783137699.897332:0:14263:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9709aff2a000 from 10 10000000:01000000:0.0:1783137699.897335:0:14263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783137699.897369:0:14263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd234400/0x88def104ac675d9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.897378:0:14263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.136@tcp lock: ffff9709bd234400/0x88def104ac675d9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.897388:0:14263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.136@tcp lock: ffff9709bd234400/0x88def104ac675d9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137699.897420:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990173056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.897540:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137699.897589:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25000 going to sleep for 11 seconds 00000100:00100000:1.0:1783137699.897842:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990173056 00000100:00100000:1.0:1783137699.897855:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990173056 00000100:00100000:1.0:1783137699.897918:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783137699.897927:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970997f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+18:14263:x1869754990173056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137699.897938:0:14261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137699.898072:0:14261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0da00/0x88def104ac675da2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88def104ac675d9b expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137699.898098:0:14261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0da00/0x88def104ac675da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88def104ac675d9b expref: 19 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137699.898109:0:14261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0da00/0x88def104ac675da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88def104ac675d9b expref: 19 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137699.898118:0:14261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0da00, rc 0) 00000100:00100000:1.0:1783137699.898361:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970997f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:14263:x1869754990173056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 434us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137699.898369:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783137699.898694:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990173056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783137699.898719:0:14263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.136@tcp lock: ffff9709bd234400/0x88def104ac675d9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675da2 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.898728:0:14263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.136@tcp lock: ffff9709bd234400/0x88def104ac675d9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88def104ac675da2 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137699.898787:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990173184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.898843:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137699.898871:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25000 going to sleep for 11 seconds 00000100:00100000:1.0:1783137699.898939:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990173184 00000100:00100000:1.0:1783137699.898943:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990173184 00000100:00100000:1.0:1783137699.899082:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783137699.899090:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:14263:x1869754990173184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783137699.899674:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:14263:x1869754990173184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 584us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137699.899682:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783137699.899741:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990173184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.899775:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990173312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783137699.899933:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137699.900066:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25000 going to sleep for 11 seconds 00000100:00100000:3.0:1783137699.900114:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990173312 00000100:00100000:3.0:1783137699.900119:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990173312 00000100:00100000:3.0:1783137699.900231:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783137699.900239:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:14263:x1869754990173312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137699.900391:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:14263:x1869754990173312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137699.900398:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783137699.900461:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:14263:1869754990173312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783137699.901528:0:16340:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783137699.901581:0:14263:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783137699.901599:0:14263:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783137699.901609:0:14263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.136@tcp lock: ffff9709bd234400/0x88def104ac675d9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675da2 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137699.901620:0:14263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.136@tcp lock: ffff9709bd234400/0x88def104ac675d9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88def104ac675da2 expref: -99 pid: 14263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137700.342060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137700.343252:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974452736 00000100:00100000:1.0:1783137700.343263:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974452736 00000100:00100000:1.0:1783137700.343321:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:1.0:1783137700.343332:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+11:13757:x1869754974452736:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783137700.343362:0:14260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137700.343381:0:14260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9709afd0ca00/0x88def104ac675da9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c44 expref: -99 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137700.343412:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9709afd0ca00/0x88def104ac675da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c44 expref: 12 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137700.343423:0:14260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9709afd0ca00/0x88def104ac675da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c44 expref: 12 pid: 14260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137700.343434:0:14260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0ca00, rc 0) 00000100:00100000:1.0:1783137700.343499:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13757:x1869754974452736:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 169us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137700.343507:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 115 00000100:00100000:1.0:1783137700.351477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137700.358926:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974452864 00000100:00100000:0.0:1783137700.358937:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974452864 00000100:00100000:0.0:1783137700.358997:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:0.0:1783137700.359017:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13757:x1869754974452864:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783137700.359595:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13757:x1869754974452864:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 588us (8126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137700.359604:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 116 00000100:00100000:1.0:1783137700.370140:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137700.372918:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974452992 00000100:00100000:3.0:1783137700.372932:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974452992 00000100:00100000:3.0:1783137700.373382:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:3.0:1783137700.373394:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13757:x1869754974452992:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137700.373612:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13757:x1869754974452992:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 220us (3481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137700.373620:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 117 00000100:00100000:1.0:1783137700.379842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137700.379886:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974453120 00000100:00100000:3.0:1783137700.379896:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974453120 00000100:00100000:3.0:1783137700.380006:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:3.0:1783137700.380028:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+12:13757:x1869754974453120:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783137700.380046:0:14261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137700.380073:0:14261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff970980030600/0x88def104ac675db0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c4b expref: -99 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137700.380105:0:14261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff970980030600/0x88def104ac675db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c4b expref: 13 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137700.380118:0:14261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff970980030600/0x88def104ac675db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c4b expref: 13 pid: 14261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137700.380127:0:14261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980030600, rc 0) 00000100:00100000:3.0:1783137700.380202:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13757:x1869754974453120:12345-192.168.203.36@tcp:101:ll_cfg_requeue.0 Request processed in 187us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137700.380233:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 118 00000100:00100000:1.0:1783137700.381930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137700.381988:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974453248 00000100:00100000:3.0:1783137700.381997:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974453248 00000100:00100000:3.0:1783137700.382126:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:3.0:1783137700.382137:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13757:x1869754974453248:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783137700.382593:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13757:x1869754974453248:12345-192.168.203.36@tcp:501:ll_cfg_requeue.0 Request processed in 457us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137700.382602:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 119 00000100:00100000:1.0:1783137700.384394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137700.384509:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974453376 00000100:00100000:3.0:1783137700.384517:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974453376 00000100:00100000:3.0:1783137700.384565:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 120 00000100:00100000:3.0:1783137700.384573:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13757:x1869754974453376:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783137700.384752:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e12153bb-60a1-4b82-8c05-faed68451b0d+13:13757:x1869754974453376:12345-192.168.203.36@tcp:503:ll_cfg_requeue.0 Request processed in 179us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137700.384760:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 120 00010000:00010000:1.0:1783137700.902990:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137701.799033:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137701.799127:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990173440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137701.799222:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137701.799352:0:14919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990173440 00000100:00100000:1.0:1783137701.799360:0:14919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990173440 00000100:00100000:1.0:1783137701.799429:0:14919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783137701.799439:0:14919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990173440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783137701.799474:0:14919:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783137701.799531:0:14919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990173440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137701.799539:0:14919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783137701.799570:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990173440:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783137701.801049:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783137701.927044:0:16298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137702.266521:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137702.266670:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974453504 00000100:00100000:2.0:1783137702.266679:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974453504 00000100:00100000:2.0:1783137702.266756:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:2.0:1783137702.266766:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:14416:x1869754974453504:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137702.266784:0:15443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137702.266834:0:15443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675db7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c52 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.266893:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.266908:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.266921:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.266934:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.266941:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.266977:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267472:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7e00/0x88def104ac675dcc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267483:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7e00/0x88def104ac675dcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267513:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7e00/0x88def104ac675dcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137702.267599:0:15443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783137702.267625:0:15443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783137702.267752:0:15443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7e00/0x88def104ac675dcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267765:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267772:0:15443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267779:0:15443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267785:0:15443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137702.267827:0:15443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267835:0:15443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267853:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987fc4900) 00010000:00010000:2.0:1783137702.267856:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137702.267860:0:15443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267875:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7000/0x88def104ac675dbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267898:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267904:0:15443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267909:0:15443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267914:0:15443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137702.267917:0:15443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267931:0:15443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267939:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff970983e34f00) 00010000:00010000:2.0:1783137702.267941:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137702.267943:0:15443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.267949:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6600/0x88def104ac675dc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.268003:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675db7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c52 expref: 8 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.268018:0:15443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7e00/0x88def104ac675dcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c52 expref: 7 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.268026:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff970983e34300) 00010000:00010000:2.0:1783137702.268028:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783137702.268031:0:15443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e7e00, rc 0) 00000100:00100000:2.0:1783137702.269322:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:14416:x1869754974453504:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 2549us (2885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137702.269333:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00080000:3.0:1783137702.269648:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137702.283709:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.286776:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974453760 00000100:00100000:0.0:1783137702.286890:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974453760 00000100:00100000:0.0:1783137702.287175:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:0.0:1783137702.287186:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:14416:x1869754974453760:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137702.287214:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.287235:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675dd3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c59 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.287308:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.287322:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.287333:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.287347:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.287354:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.287360:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.289104:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675de8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.289129:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675de8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.289139:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675de8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137702.289150:0:14268:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783137702.290341:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290355:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290362:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290368:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137702.290372:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290380:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290393:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff970983e34300) 00010000:00010000:0.0:1783137702.290397:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137702.290432:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290439:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675dda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290454:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290473:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290479:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290483:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137702.290486:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290493:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290501:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9709860f4100) 00010000:00010000:0.0:1783137702.290504:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137702.290507:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.290511:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675de1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.292311:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675dd3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c59 expref: 10 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.292336:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235a00/0x88def104ac675de8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c59 expref: 9 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.292344:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9709860f4300) 00010000:00010000:0.0:1783137702.292347:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137702.292359:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235a00, rc 0) 00000100:00100000:0.0:1783137702.292823:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+9:14416:x1869754974453760:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 5635us (9119us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783137702.292833:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:1.0:1783137702.300197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137702.300339:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974453888 00000100:00100000:2.0:1783137702.300349:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974453888 00000100:00100000:2.0:1783137702.300404:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:2.0:1783137702.300413:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+9:14416:x1869754974453888:12345-192.168.203.36@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783137702.300518:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+9:14416:x1869754974453888:12345-192.168.203.36@tcp:59:lhsmtool_posix.0 Request processed in 105us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137702.300525:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:3.0:1783137702.362534:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137702.362841:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974454016 00000100:00100000:1.0:1783137702.362851:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974454016 00000100:00100000:1.0:1783137702.362899:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:1.0:1783137702.362909:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+9:14422:x1869754974454016:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1783137702.362995:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137702.363021:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675df6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c60 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.363086:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.363101:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.363114:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.363130:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.363139:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.363146:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364730:0:14267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364744:0:14267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364759:0:14267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364765:0:14267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137702.364770:0:14267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364778:0:14267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364814:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987fc4900) 00010000:00010000:1.0:1783137702.364818:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137702.364823:0:14267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364829:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675dfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364844:0:14267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364851:0:14267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364856:0:14267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364862:0:14267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137702.364865:0:14267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364882:0:14267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364891:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff970990e51900) 00010000:00010000:1.0:1783137702.364894:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137702.364897:0:14267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.364903:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.365745:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675df6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c60 expref: 10 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.365760:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987fc4900) 00010000:00010000:1.0:1783137702.365763:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137702.365768:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675df6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c60 expref: 10 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.365780:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0cc00, rc 0) 00000100:00100000:1.0:1783137702.367034:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+9:14422:x1869754974454016:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 4119us (4501us total) trans 0 rc 301/301 00000100:00100000:1.0:1783137702.367046:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:3.0:1783137702.372737:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137702.373228:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974454144 00000100:00100000:1.0:1783137702.373240:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974454144 00000100:00100000:1.0:1783137702.373285:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:1.0:1783137702.373296:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dbff8b30-85ae-47b7-8614-cc3f77566a29+9:14422:x1869754974454144:12345-192.168.203.36@tcp:700:lfs.0 00000100:00100000:1.0:1783137702.373405:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dbff8b30-85ae-47b7-8614-cc3f77566a29+9:14422:x1869754974454144:12345-192.168.203.36@tcp:700:lfs.0 Request processed in 110us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137702.373423:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:3.0:1783137702.380895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137702.381083:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974454400 00000100:00100000:2.0:1783137702.381092:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974454400 00000100:00100000:2.0:1783137702.381158:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:2.0:1783137702.381168:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+9:14422:x1869754974454400:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:2.0:1783137702.381233:0:15443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137702.381260:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff970980031800/0x88def104ac675d39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72bdb expref: 9 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.381292:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987fc4900) 00010000:00010000:2.0:1783137702.381297:0:15443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137702.381872:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.381889:0:15443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c3d expref: 5 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.381909:0:15443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.382253:0:15443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c3d expref: 5 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.382267:0:15443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c3d expref: 5 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137702.382284:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15443:1869754990173568:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137702.382684:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a092fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783137702.393874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137702.395470:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15443:1869754990173568:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137702.395503:0:15443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137702.395605:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974454528 00000100:00100000:3.0:1783137702.395612:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974454528 00010000:00010000:3.0:1783137702.395675:0:14253:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c3d expref: 6 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137702.395712:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:3.0:1783137702.395722:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57e4b930-3497-4532-8753-869c6eeffd65+6:2352:x1869754974454528:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137702.395737:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137702.395745:0:14253:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c3d expref: 6 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.395756:0:14253:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c3d expref: 6 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.395777:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6000/0x88def104ac675d71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c3d expref: 6 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.395829:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987fc4900) 00010000:00010000:3.0:1783137702.395834:0:14253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.395843:0:14253:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.395851:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.395873:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1783137702.396083:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783137702.396143:0:15443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.396158:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.396182:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.396191:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.396209:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137702.397307:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57e4b930-3497-4532-8753-869c6eeffd65+5:2352:x1869754974454528:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 1580us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137702.397319:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000004:00200000:1.0:1783137702.401837:0:15443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783137702.401861:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.401872:0:15443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.401879:0:15443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.401885:0:15443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137702.401889:0:15443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.401913:0:15443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.401930:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff970987fc4900) 00010000:00010000:1.0:1783137702.401933:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137702.401938:0:15443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.401944:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675e0b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137702.401980:0:15443:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f57d9d88 reply state 00000000ac59fe60 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137702.401990:0:15443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783137702.402097:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+10:14422:x1869754974454400:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 20926us (21207us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783137702.402106:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00010000:00010000:3.0:1783137702.404114:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.404130:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.404138:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.404144:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0cc00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137702.404148:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.404156:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.404395:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff970990e51900) 00010000:00010000:3.0:1783137702.404398:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137702.404403:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.404409:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e12 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137702.515714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.516531:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974454656 00000100:00100000:0.0:1783137702.516542:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974454656 00000100:00100000:0.0:1783137702.516628:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1783137702.516644:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+9:14430:x1869754974454656:12345-192.168.203.36@tcp:101:lctl.0 00010000:00010000:0.0:1783137702.516669:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.516691:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c67 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.516750:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675e20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.516763:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675e20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.516774:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675e20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137702.516860:0:14268:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783137702.516864:0:14268:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137702.516911:0:14268:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675e20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.516996:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c67 expref: 11 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.517079:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235800/0x88def104ac675e20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c67 expref: 10 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.517547:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4100) 00010000:00010000:0.0:1783137702.517550:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137702.517553:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235800, rc 0) 00000100:00100000:0.0:1783137702.517669:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+10:14430:x1869754974454656:12345-192.168.203.36@tcp:101:lctl.0 Request processed in 1030us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.517676:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:1.0:1783137702.552195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.552303:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974454784 00000100:00100000:0.0:1783137702.552313:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974454784 00000100:00100000:0.0:1783137702.552372:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:0.0:1783137702.552381:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57e4b930-3497-4532-8753-869c6eeffd65+5:14431:x1869754974454784:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137702.552402:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.552430:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c6e expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.552491:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675e2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.552504:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.552516:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137702.552568:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783137702.552582:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137702.552604:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.552623:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c6e expref: 7 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.552635:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234a00/0x88def104ac675e2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c6e expref: 6 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.552641:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4100) 00010000:00010000:0.0:1783137702.552643:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137702.552646:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234a00, rc 0) 00000100:00100000:0.0:1783137702.552695:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57e4b930-3497-4532-8753-869c6eeffd65+6:14431:x1869754974454784:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 316us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.552700:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 21 00000100:00100000:2.0:1783137702.555955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137702.556035:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974454912 00000100:00100000:1.0:1783137702.556044:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974454912 00000100:00100000:1.0:1783137702.556114:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:1.0:1783137702.556124:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57e4b930-3497-4532-8753-869c6eeffd65+6:14431:x1869754974454912:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:1.0:1783137702.556143:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137702.556161:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c75 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556228:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556254:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556267:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556281:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556287:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556294:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556497:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556505:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556513:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137702.556552:0:14267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783137702.556556:0:14267:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137702.556578:0:14267:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556589:0:14267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556603:0:14267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556609:0:14267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556614:0:14267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0c400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137702.556619:0:14267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556626:0:14267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556639:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4100) 00010000:00010000:1.0:1783137702.556642:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137702.556647:0:14267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556654:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556667:0:14267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556672:0:14267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556678:0:14267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556682:0:14267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0dc00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137702.556692:0:14267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556698:0:14267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556707:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff970990e51b00) 00010000:00010000:1.0:1783137702.556709:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137702.556712:0:14267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556717:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675e43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556747:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c75 expref: 8 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556760:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c75 expref: 7 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.556767:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff970990e51d00) 00010000:00010000:1.0:1783137702.556769:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137702.556771:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0cc00, rc 0) 00000100:00100000:1.0:1783137702.556877:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57e4b930-3497-4532-8753-869c6eeffd65+7:14431:x1869754974454912:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 744us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137702.556884:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 22 00000100:00100000:3.0:1783137702.564211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.564304:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974455168 00000100:00100000:0.0:1783137702.564314:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974455168 00000100:00100000:0.0:1783137702.564377:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:0.0:1783137702.564387:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57e4b930-3497-4532-8753-869c6eeffd65+7:14431:x1869754974455168:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137702.564406:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.564427:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c7c expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137702.564554:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783137702.564665:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c7c expref: 9 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.564679:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4100) 00010000:00010000:0.0:1783137702.564697:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137702.564702:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c7c expref: 9 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.564715:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235400, rc 0) 00000100:00100000:0.0:1783137702.564771:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57e4b930-3497-4532-8753-869c6eeffd65+8:14431:x1869754974455168:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 385us (577us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1783137702.564777:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 23 00000100:00100000:3.0:1783137702.570519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137702.570617:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974455424 00000100:00100000:1.0:1783137702.570627:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974455424 00000100:00100000:1.0:1783137702.570682:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:1.0:1783137702.570690:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bca7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57e4b930-3497-4532-8753-869c6eeffd65+8:14431:x1869754974455424:12345-192.168.203.36@tcp:36:lfs.0 00010000:00010000:1.0:1783137702.570756:0:14267:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137702.570780:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c75 expref: 8 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.570834:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff970990e51d00) 00010000:00010000:1.0:1783137702.570844:0:14267:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137702.570867:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.570879:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.570887:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783137702.571087:0:14267:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9f6ace6 reply state 00000000e87a5ad7 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137702.571097:0:14267:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783137702.571111:0:14267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1783137702.571208:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bca7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57e4b930-3497-4532-8753-869c6eeffd65+9:14431:x1869754974455424:12345-192.168.203.36@tcp:36:lfs.0 Request processed in 510us (689us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1783137702.571215:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:2.0:1783137702.576656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.577361:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974455680 00000100:00100000:0.0:1783137702.577371:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974455680 00000100:00100000:0.0:1783137702.577436:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:0.0:1783137702.577447:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57e4b930-3497-4532-8753-869c6eeffd65+9:14431:x1869754974455680:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:0.0:1783137702.577692:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57e4b930-3497-4532-8753-869c6eeffd65+10:14431:x1869754974455680:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 246us (1045us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783137702.577700:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00010000:00010000:3.0:1783137702.578865:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.578882:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.578890:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.578896:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137702.578900:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.578908:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.578923:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff970990e51b00) 00010000:00010000:3.0:1783137702.578926:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1783137702.578930:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137702.579069:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e5f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137702.580713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.581214:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974455936 00000100:00100000:0.0:1783137702.581224:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974455936 00000100:00100000:0.0:1783137702.581332:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:0.0:1783137702.581344:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57e4b930-3497-4532-8753-869c6eeffd65+9:14431:x1869754974455936:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137702.581365:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.581381:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c83 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581455:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581468:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581493:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581507:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581514:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581521:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137702.581642:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783137702.581732:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581740:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581747:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581760:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137702.581764:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581771:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581782:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4100) 00010000:00010000:0.0:1783137702.581785:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137702.581837:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581843:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675e6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581854:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581860:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581864:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581869:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234600 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137702.581871:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581876:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581883:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9709860f4500) 00010000:00010000:0.0:1783137702.581885:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783137702.581888:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581893:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675e74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581946:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c83 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581969:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4100) 00010000:00010000:0.0:1783137702.581971:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137702.581975:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675e66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c83 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.581985:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235400, rc 0) 00000100:00100000:0.0:1783137702.582041:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57e4b930-3497-4532-8753-869c6eeffd65+10:14431:x1869754974455936:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 700us (1335us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1783137702.582048:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 25 00000100:00100000:1.0:1783137702.584547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.584759:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974456064 00000100:00100000:0.0:1783137702.584768:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974456064 00000100:00100000:0.0:1783137702.584844:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:0.0:1783137702.584854:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57e4b930-3497-4532-8753-869c6eeffd65+10:14431:x1869754974456064:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137702.584876:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.584898:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675e82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c8a expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.584986:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.585000:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.585011:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137702.585062:0:14267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783137702.585077:0:14267:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137702.585105:0:14267:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.585130:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675e82 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c8a expref: 12 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.585149:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c8a expref: 11 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.585158:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9709860f4d00) 00010000:00010000:0.0:1783137702.585161:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783137702.585164:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234e00, rc 0) 00000100:00100000:0.0:1783137702.585234:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57e4b930-3497-4532-8753-869c6eeffd65+11:14431:x1869754974456064:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 381us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.585240:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 26 00000100:00100000:2.0:1783137702.590018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.590103:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974456192 00000100:00100000:0.0:1783137702.590113:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974456192 00000100:00100000:0.0:1783137702.590449:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:0.0:1783137702.590460:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57e4b930-3497-4532-8753-869c6eeffd65+11:14431:x1869754974456192:12345-192.168.203.36@tcp:37:lfs.0 00000100:00100000:1.0:1783137702.593970:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57e4b930-3497-4532-8753-869c6eeffd65+11:14431:x1869754974456192:12345-192.168.203.36@tcp:37:lfs.0 Request processed in 3501us (4046us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137702.593988:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:1.0:1783137702.597562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137702.597657:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974456448 00000100:00100000:2.0:1783137702.597683:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974456448 00000100:00100000:2.0:1783137702.597738:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:2.0:1783137702.597748:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970989ce2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57e4b930-3497-4532-8753-869c6eeffd65+11:14431:x1869754974456448:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137702.598040:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970989ce2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57e4b930-3497-4532-8753-869c6eeffd65+12:14431:x1869754974456448:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 292us (487us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783137702.598049:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:2.0:1783137702.673154:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137702.673560:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974456576 00000100:00100000:1.0:1783137702.673582:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974456576 00000100:00100000:1.0:1783137702.673641:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:1.0:1783137702.673651:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+10:14437:x1869754974456576:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:1.0:1783137702.673672:0:15443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783137702.673692:0:15443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c91 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.673752:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.673764:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.673775:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.673789:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.673839:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.673845:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.674127:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675ea5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.674137:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.674144:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137702.675081:0:15443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783137702.675089:0:15443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137702.675145:0:15443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.675159:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676011:0:15443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676024:0:15443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676030:0:15443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0cc00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137702.676034:0:15443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676041:0:15443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676057:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4100) 00010000:00010000:1.0:1783137702.676060:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137702.676064:0:15443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676069:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0cc00/0x88def104ac675e97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676085:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676111:0:15443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676117:0:15443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676122:0:15443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709afd0d200 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137702.676126:0:15443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676132:0:15443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676141:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff970990e51d00) 00010000:00010000:1.0:1783137702.676143:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137702.676146:0:15443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.676150:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0d200/0x88def104ac675e9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.678130:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0c400/0x88def104ac675e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c91 expref: 12 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.678160:0:15443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709afd0dc00/0x88def104ac675ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c91 expref: 11 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137702.678169:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9709860f4d00) 00010000:00010000:1.0:1783137702.678237:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783137702.678256:0:15443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709afd0dc00, rc 0) 00000100:00100000:1.0:1783137702.678334:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+11:14437:x1869754974456576:12345-192.168.203.36@tcp:101:bash.0 Request processed in 4683us (5188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137702.678342:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 27 00000100:00100000:3.0:1783137702.682116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137702.683079:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974456832 00000100:00100000:2.0:1783137702.683090:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974456832 00000100:00100000:2.0:1783137702.683156:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:2.0:1783137702.683167:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+11:14437:x1869754974456832:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:2.0:1783137702.683204:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137702.683225:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7200/0x88def104ac675eac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c98 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.683349:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.683365:0:14268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c8a expref: 11 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.683374:0:14268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.683410:0:14268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c8a expref: 11 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.683422:0:14268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c8a expref: 11 pid: 14267 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137702.683450:0:14268:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14268:1869754990173696:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137702.683545:0:14268:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709a092fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137702.687184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.687283:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974456960 00000100:00100000:0.0:1783137702.687292:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974456960 00010000:00010000:0.0:1783137702.687342:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c8a expref: 12 pid: 14267 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137702.687382:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:0.0:1783137702.687392:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57e4b930-3497-4532-8753-869c6eeffd65+12:2351:x1869754974456960:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137702.687407:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137702.687427:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c8a expref: 12 pid: 14267 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.687441:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c8a expref: 12 pid: 14267 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.687462:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9709860f4d00) 00010000:00010000:0.0:1783137702.687467:0:14251:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.687476:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.687483:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.687499:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137702.687555:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57e4b930-3497-4532-8753-869c6eeffd65+12:2351:x1869754974456960:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 164us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.687563:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00010000:00010000:2.0:1783137702.687751:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675e89 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c8a expref: 11 pid: 14267 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137702.687767:0:14268:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14268:1869754990173696:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137702.687785:0:14268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.687827:0:14268:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.687833:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.687855:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.687863:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.687871:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.693321:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.693352:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.693379:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137702.693391:0:14268:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783137702.693900:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.693909:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.693916:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.693992:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137702.693997:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.694005:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.694019:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9709860f4d00) 00010000:00010000:2.0:1783137702.694023:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137702.694027:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.694034:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675eb3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137702.694063:0:14268:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e5e3f33 reply state 000000006139049e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137702.694085:0:14268:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783137702.694128:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7200/0x88def104ac675eac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c98 expref: 14 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.694145:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c98 expref: 13 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.694236:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:2.0:1783137702.694239:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783137702.694241:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e6800, rc 0) 00000100:00100000:2.0:1783137702.694322:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+14:14437:x1869754974456832:12345-192.168.203.36@tcp:101:bash.0 Request processed in 11157us (12216us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783137702.694331:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00010000:00010000:2.0:1783137702.701025:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.701041:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.701049:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.701055:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137702.701060:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.701067:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.701099:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff970983e34f00) 00010000:00010000:2.0:1783137702.701102:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137702.701107:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.701113:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675eba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137702.723880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.724602:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974457088 00000100:00100000:0.0:1783137702.724612:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974457088 00000100:00100000:0.0:1783137702.724672:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:0.0:1783137702.724682:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+13:14437:x1869754974457088:12345-192.168.203.36@tcp:101:bash.0 00010000:00010000:0.0:1783137702.724705:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.724722:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675ecf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72c9f expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.724786:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.724857:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.724869:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137702.725151:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783137702.725156:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137702.725256:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.725268:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.725293:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675ecf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c9f expref: 15 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.725312:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c9f expref: 14 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.725321:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:0.0:1783137702.725379:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137702.725383:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235400, rc 0) 00000100:00100000:0.0:1783137702.726386:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+14:14437:x1869754974457088:12345-192.168.203.36@tcp:101:bash.0 Request processed in 1698us (2507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.726396:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:3.0:1783137702.738237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137702.738420:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974457344 00000100:00100000:2.0:1783137702.738429:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974457344 00000100:00100000:2.0:1783137702.738482:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:2.0:1783137702.738492:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+14:14437:x1869754974457344:12345-192.168.203.36@tcp:35:bash.0 00000100:00100000:2.0:1783137702.738876:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+15:14437:x1869754974457344:12345-192.168.203.36@tcp:35:bash.0 Request processed in 383us (646us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783137702.738885:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:2.0:1783137702.823054:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990174080:0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.823219:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783137702.823226:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990173952:0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.823275:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990174464:0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.823334:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990174080 00000100:00100000:2.0:1783137702.823341:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990174080 00000100:00100000:2.0:1783137702.823388:0:14915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990173952 00000100:00100000:2.0:1783137702.823392:0:14915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990173952 00000100:00100000:2.0:1783137702.823432:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783137702.823440:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990174080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823513:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990174080:12345-0@lo:400:kworker.0 Request processed in 73us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137702.823520:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783137702.823539:0:14915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783137702.823546:0:14915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990173952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823575:0:14915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990173952:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137702.823581:0:14915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1783137702.823601:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783137702.823627:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990173952:0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823639:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990174080:0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823663:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990174464 00000100:00100000:2.0:1783137702.823667:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990174464 00000100:00100000:2.0:1783137702.823702:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783137702.823709:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990174464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137702.823711:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3309:1869754990173824:0@lo:400:kworker.0 00000100:00100000:3.0:1783137702.823739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.823740:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990174464:12345-0@lo:400:kworker.0 Request processed in 31us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137702.823746:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783137702.823761:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990174336:0@lo:400:kworker.0 00000100:00080000:2.0:1783137702.823761:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137702.823780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.823785:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff970986663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990174592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137702.823821:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137702.823827:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990174208:0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823827:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.823848:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990174464:0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823868:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990174592 00000100:00100000:2.0:1783137702.823876:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990174592 00000100:00100000:3.0:1783137702.823898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137702.823898:0:14918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783137702.823903:0:14918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990174592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137702.823919:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990174336 00000100:00100000:3.0:1783137702.823923:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990174336 00002000:00000024:2.0:1783137702.823930:0:14918:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783137702.823948:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990174208 00000100:00100000:3.0:1783137702.823950:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990174208 00000100:00100000:2.0:1783137702.823965:0:14918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990174592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137702.823966:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783137702.823971:0:14918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783137702.823972:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990174336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.823996:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff970986663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990174592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137702.824004:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869754990174336:12345-0@lo:400:kworker.0 Request processed in 33us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137702.824009:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1783137702.824018:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137702.824021:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783137702.824027:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990174208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137702.824045:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1869754990174336:0@lo:400:kworker.0 00000100:00100000:3.0:1783137702.824053:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869754990174208:12345-0@lo:400:kworker.0 Request processed in 26us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137702.824057:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869754990174208:0@lo:400:kworker.0 00000100:00100000:3.0:1783137702.824058:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783137702.824620:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990173824 00000100:00100000:1.0:1783137702.824626:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990173824 00000100:00100000:1.0:1783137702.824667:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783137702.824675:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3309:x1869754990173824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137702.824725:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3309:x1869754990173824:12345-0@lo:400:kworker.0 Request processed in 51us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137702.824731:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783137702.825851:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3309:1869754990173824:0@lo:400:kworker.0 00000100:00100000:3.0:1783137702.849342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137702.849659:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974457600 00000100:00100000:2.0:1783137702.849669:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974457600 00000100:00100000:2.0:1783137702.849738:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:2.0:1783137702.849747:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+15:14447:x1869754974457600:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:2.0:1783137702.849770:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137702.849788:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675edd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72ca6 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137702.850218:0:14267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783137702.850337:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675edd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ca6 expref: 17 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.850352:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9709860f4100) 00010000:00010000:2.0:1783137702.850368:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137702.850374:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675edd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ca6 expref: 17 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.850388:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e6c00, rc 0) 00000100:00100000:2.0:1783137702.852252:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+16:14447:x1869754974457600:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 2496us (2909us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1783137702.852263:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 30 00000100:00100000:3.0:1783137702.864947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137702.865101:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974457856 00000100:00100000:1.0:1783137702.865111:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974457856 00000100:00100000:1.0:1783137702.865167:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:1.0:1783137702.865178:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+16:14447:x1869754974457856:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:1.0:1783137702.865449:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+17:14447:x1869754974457856:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 272us (517us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783137702.865457:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:3.0:1783137702.929747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.933992:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974458112 00000100:00100000:0.0:1783137702.934006:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974458112 00000100:00100000:0.0:1783137702.934089:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:0.0:1783137702.934113:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+17:14450:x1869754974458112:12345-192.168.203.36@tcp:101:lfs.0 00010000:00010000:0.0:1783137702.934138:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137702.934158:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675eeb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cad expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.934262:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675ef2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.934277:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.934287:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137702.934298:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783137702.934422:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234c00/0x88def104ac675eeb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cad expref: 20 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.934441:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cad expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.934450:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:0.0:1783137702.934453:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137702.934457:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd234600, rc 0) 00000100:00100000:0.0:1783137702.934525:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+19:14450:x1869754974458112:12345-192.168.203.36@tcp:101:lfs.0 Request processed in 414us (4786us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1783137702.934532:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 31 00000100:00100000:3.0:1783137702.937149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137702.937307:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974458240 00000100:00100000:0.0:1783137702.937317:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974458240 00000100:00100000:0.0:1783137702.937385:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:0.0:1783137702.937394:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+19:14450:x1869754974458240:12345-192.168.203.36@tcp:54:lfs.0 00010000:00010000:0.0:1783137702.937452:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.937466:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.937476:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.937500:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.937507:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.937514:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.937519:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:0.0:1783137702.937524:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.937530:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.937540:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:0.0:1783137702.937543:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783137702.937546:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137702.937560:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f00 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137702.937625:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+19:14450:x1869754974458240:12345-192.168.203.36@tcp:54:lfs.0 Request processed in 231us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137702.937632:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 32 00000100:00100000:3.0:1783137702.941388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137702.941428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137702.941485:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974458624 00000100:00100000:1.0:1783137702.941495:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974458624 00000100:00100000:1.0:1783137702.941552:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:1.0:1783137702.941562:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+19:14450:x1869754974458624:12345-192.168.203.36@tcp:35:lfs.0 00000100:00100000:2.0:1783137702.941639:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974458368 00000100:00100000:2.0:1783137702.941644:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974458368 00000100:00100000:2.0:1783137702.941683:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:2.0:1783137702.941689:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:2351:x1869754974458368:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137702.941699:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137702.941718:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234600/0x88def104ac675ef2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cad expref: 21 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137702.941734:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:2.0:1783137702.941739:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137702.941814:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+20:2351:x1869754974458368:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 100us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137702.941823:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:1.0:1783137702.942761:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+19:14450:x1869754974458624:12345-192.168.203.36@tcp:35:lfs.0 Request processed in 1195us (1326us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1783137702.942771:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00010000:00010000:0.0:1783137702.952737:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137703.223784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137703.224301:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974458880 00000100:00100000:0.0:1783137703.224311:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974458880 00000100:00100000:0.0:1783137703.224377:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:0.0:1783137703.224389:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+19:14481:x1869754974458880:12345-192.168.203.36@tcp:101:cat.0 00010000:00010000:0.0:1783137703.224412:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137703.224432:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f07 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cb4 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.224560:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675f0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.224574:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675f0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.224587:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675f0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137703.224598:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783137703.224754:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234800/0x88def104ac675f07 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cb4 expref: 22 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.224772:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675f0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cb4 expref: 21 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.224844:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:0.0:1783137703.224848:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137703.224851:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235e00, rc 0) 00000100:00100000:0.0:1783137703.224911:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:14481:x1869754974458880:12345-192.168.203.36@tcp:101:cat.0 Request processed in 525us (1136us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1783137703.224919:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 33 00000100:00100000:3.0:1783137703.231022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.231066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.231105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137703.231216:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974459008 00000100:00100000:2.0:1783137703.231225:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974459008 00000100:00100000:2.0:1783137703.231288:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:2.0:1783137703.231299:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:2352:x1869754974459008:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137703.231314:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137703.231336:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675f0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cb4 expref: 21 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137703.231627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.231660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.231684:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.231713:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.231737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.231758:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974459264 00000100:00100000:3.0:1783137703.231762:0:16264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974459264 00000100:00100000:3.0:1783137703.231820:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974459776 00000100:00100000:3.0:1783137703.231824:0:16264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974459776 00000100:00100000:3.0:1783137703.231837:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974459392 00000100:00100000:3.0:1783137703.231839:0:16264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974459392 00000100:00100000:3.0:1783137703.231850:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974459648 00000100:00100000:3.0:1783137703.231852:0:16264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974459648 00000100:00100000:3.0:1783137703.231865:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:3.0:1783137703.231871:0:16264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2352:x1869754974459264:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137703.231933:0:16264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2352:x1869754974459264:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 61us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137703.232008:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:3.0:1783137703.232027:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:3.0:1783137703.232034:0:16264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57e4b930-3497-4532-8753-869c6eeffd65+5:2352:x1869754974459776:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137703.232061:0:16264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57e4b930-3497-4532-8753-869c6eeffd65+5:2352:x1869754974459776:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137703.232067:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:3.0:1783137703.232078:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:3.0:1783137703.232084:0:16264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2352:x1869754974459392:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137703.232241:0:16264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2352:x1869754974459392:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 156us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137703.232257:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:3.0:1783137703.232271:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:3.0:1783137703.232277:0:16264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57e4b930-3497-4532-8753-869c6eeffd65+5:2352:x1869754974459648:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137703.232301:0:16264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57e4b930-3497-4532-8753-869c6eeffd65+5:2352:x1869754974459648:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137703.232307:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00080000:3.0:1783137703.232323:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137703.232326:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137703.232334:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974460032 00000100:00100000:3.0:1783137703.232338:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974460032 00000100:00100000:3.0:1783137703.232362:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:3.0:1783137703.232550:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:14481:x1869754974460032:12345-192.168.203.36@tcp:35:cat.0 00000100:00100000:0.0:1783137703.232824:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974459136 00000100:00100000:0.0:1783137703.232830:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974459136 00000100:00100000:0.0:1783137703.232859:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 122 00000100:00100000:0.0:1783137703.232866:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+13:2352:x1869754974459136:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137703.232897:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e12153bb-60a1-4b82-8c05-faed68451b0d+13:2352:x1869754974459136:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 32us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137703.232902:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 122 00010000:00010000:2.0:1783137703.233304:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:2.0:1783137703.233314:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137703.233352:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986661c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:2352:x1869754974459008:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 2055us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137703.233360:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:3.0:1783137703.233865:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:14481:x1869754974460032:12345-192.168.203.36@tcp:35:cat.0 Request processed in 1495us (2237us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1783137703.233873:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 8 00000100:00100000:1.0:1783137703.238773:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974459520 00000100:00100000:1.0:1783137703.238787:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974459520 00000100:00100000:1.0:1783137703.239230:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 24 00000100:00100000:1.0:1783137703.239242:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57e4b930-3497-4532-8753-869c6eeffd65+11:2352:x1869754974459520:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:1.0:1783137703.239328:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57e4b930-3497-4532-8753-869c6eeffd65+11:2352:x1869754974459520:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 89us (8231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137703.239335:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 24 00000040:00080000:0.0:1783137703.272242:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783137703.307834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.307948:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974460288 00000100:00100000:3.0:1783137703.307957:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974460288 00000100:00100000:3.0:1783137703.308000:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:3.0:1783137703.308108:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:14487:x1869754974460288:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:3.0:1783137703.308130:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783137703.308147:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f1c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cbb expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.308248:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.308278:0:14266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c98 expref: 22 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.308286:0:14266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c9f expref: 22 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.308294:0:14266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.308324:0:14266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c9f expref: 22 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.308336:0:14266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c9f expref: 22 pid: 14266 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137703.308348:0:14266:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd08aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14266:1869754990174720:192.168.203.36@tcp:104: 00010000:00010000:3.0:1783137703.308442:0:14266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c98 expref: 22 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.308451:0:14266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c98 expref: 22 pid: 14268 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137703.308459:0:14266:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd088e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14266:1869754990174848:192.168.203.36@tcp:104: 00000100:00100000:3.0:1783137703.308482:0:14266:0:(client.c:2701:ptlrpc_set_wait()) set ffff970988a21d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783137703.311569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137703.311662:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974460416 00000100:00100000:2.0:1783137703.311672:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974460416 00010000:00010000:2.0:1783137703.311709:0:14252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c9f expref: 23 pid: 14266 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137703.311754:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:2.0:1783137703.311763:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709c19e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+23:2351:x1869754974460416:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137703.311777:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137703.311783:0:14252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c9f expref: 23 pid: 14266 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.311824:0:14252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c9f expref: 23 pid: 14266 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.311845:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:2.0:1783137703.311850:0:14252:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.311858:0:14252:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.311880:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137703.311930:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709c19e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+23:2351:x1869754974460416:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 168us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137703.311937:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00010000:00010000:0.0:1783137703.312920:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675ed6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c9f expref: 22 pid: 14266 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137703.312940:0:14266:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd08aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14266:1869754990174720:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137703.312953:0:14266:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd088e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14266:1869754990174848:192.168.203.36@tcp:104: 00010000:00010000:0.0:1783137703.312973:0:14266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137703.317282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.317375:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974460544 00000100:00100000:3.0:1783137703.317396:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974460544 00010000:00010000:3.0:1783137703.317431:0:14253:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c98 expref: 22 pid: 14268 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137703.317478:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:3.0:1783137703.317488:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+22:2351:x1869754974460544:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783137703.317501:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137703.317508:0:14253:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c98 expref: 22 pid: 14268 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.317520:0:14253:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c98 expref: 22 pid: 14268 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.317539:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675ec1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72c98 expref: 22 pid: 14268 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.317556:0:14253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:3.0:1783137703.317561:0:14253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.317570:0:14253:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.317577:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.317648:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137703.317708:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:2351:x1869754974460544:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 221us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137703.317725:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00010000:00010000:0.0:1783137703.319274:0:14266:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.319301:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137703.319320:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783137703.319491:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f1c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cbb expref: 22 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.319511:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff970980031e00/0x88def104ac675f23 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cbb expref: 21 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.319520:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:0.0:1783137703.319523:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783137703.319526:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff970980031e00, rc 0) 00000100:00100000:0.0:1783137703.319578:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:14487:x1869754974460288:12345-192.168.203.36@tcp:101:dd.0 Request processed in 11569us (11751us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1783137703.319586:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 34 00000100:00100000:2.0:1783137703.321630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137703.321770:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974460800 00000100:00100000:0.0:1783137703.321779:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974460800 00000100:00100000:0.0:1783137703.321865:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 35 00000100:00100000:0.0:1783137703.321875:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+21:14487:x1869754974460800:12345-192.168.203.36@tcp:36:dd.0 00010000:00010000:0.0:1783137703.322117:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.322133:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.322143:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783137703.322219:0:14267:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1783137703.322244:0:14267:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000890900b0 reply state 0000000059335cd9 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137703.322252:0:14267:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783137703.322333:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14487:x1869754974460800:12345-192.168.203.36@tcp:36:dd.0 Request processed in 458us (710us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1783137703.322340:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 35 00000020:00080000:0.0:1783137703.322345:0:14267:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783137703.327700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137703.328164:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974460928 00000100:00100000:2.0:1783137703.328172:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974460928 00000100:00100000:2.0:1783137703.328238:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 36 00000100:00100000:2.0:1783137703.328249:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14487:x1869754974460928:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1783137703.328273:0:15443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137703.328294:0:15443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7200/0x88def104ac675f38 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cc2 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.328351:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7200/0x88def104ac675f38 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc2 expref: 25 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.328365:0:15443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7200/0x88def104ac675f38 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc2 expref: 25 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.328384:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:2.0:1783137703.328387:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137703.328390:0:15443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e7200, rc 0) 00000100:00100000:2.0:1783137703.328457:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+25:14487:x1869754974460928:12345-192.168.203.36@tcp:101:dd.0 Request processed in 210us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137703.328465:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 36 00010000:00010000:3.0:1783137703.350126:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.350143:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.350151:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.350157:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137703.350162:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.350169:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.350186:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:3.0:1783137703.350189:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137703.350205:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.350211:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235400/0x88def104ac675f31 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137703.350465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137703.350723:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974461184 00000100:00100000:3.0:1783137703.350733:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974461184 00000100:00100000:3.0:1783137703.350820:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:3.0:1783137703.350830:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14487:x1869754974461184:12345-192.168.203.36@tcp:103:dd.0 00010000:00010000:3.0:1783137703.350844:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137703.350873:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7200/0x88def104ac675f38 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc2 expref: 24 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137703.350896:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:3.0:1783137703.350901:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137703.350955:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+23:14487:x1869754974461184:12345-192.168.203.36@tcp:103:dd.0 Request processed in 126us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137703.350963:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:1.0:1783137703.358743:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137703.358964:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974461312 00000100:00100000:0.0:1783137703.358973:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974461312 00000100:00100000:0.0:1783137703.359043:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:0.0:1783137703.359054:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+23:14487:x1869754974461312:12345-192.168.203.36@tcp:58:dd.0 00010000:00010000:0.0:1783137703.359144:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.359161:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137703.359173:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783137703.369035:0:14267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783137703.369201:0:14267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1783137703.369269:0:14267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1783137703.369377:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+23:14487:x1869754974461312:12345-192.168.203.36@tcp:58:dd.0 Request processed in 10321us (10639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137703.369389:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 37 00000100:00100000:1.0:1783137703.371647:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137703.371904:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974461440 00000100:00100000:2.0:1783137703.371914:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974461440 00000100:00100000:2.0:1783137703.371978:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 38 00000100:00100000:2.0:1783137703.371989:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+23:14487:x1869754974461440:12345-192.168.203.36@tcp:101:dd.0 00010000:00010000:2.0:1783137703.372018:0:15443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137703.372039:0:15443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675f46 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cc9 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.372092:0:15443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.372103:0:15443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675f46 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc9 expref: 24 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.372121:0:15443:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.372135:0:15443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675f46 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc9 expref: 24 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.372146:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:2.0:1783137703.372148:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137703.372151:0:15443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675f46 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc9 expref: 24 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137703.372170:0:15443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e7c00, rc 0) 00000100:00100000:2.0:1783137703.372232:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14487:x1869754974461440:12345-192.168.203.36@tcp:101:dd.0 Request processed in 245us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137703.372240:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 38 00010000:00010000:0.0:1783137703.976291:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137704.295030:0:14300:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783137704.295039:0:14300:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137704.295090:0:14300:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783137704.295096:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783137704.295220:0:14300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14300:1869754990174976:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783137704.295405:0:14300:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709897b9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137704.301732:0:14300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14300:1869754990174976:192.168.203.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783137704.302956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137704.304962:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974461568 00000100:00100000:0.0:1783137704.304975:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974461568 00000100:00100000:0.0:1783137704.305098:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:0.0:1783137704.305109:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14488:x1869754974461568:12345-192.168.203.36@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783137704.305212:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14488:x1869754974461568:12345-192.168.203.36@tcp:900:lhsmtool_posix.0 Request processed in 105us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137704.305220:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00080000:3.0:1783137704.306843:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137704.307744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.307831:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974461696 00000100:00100000:2.0:1783137704.307839:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974461696 00000100:00100000:2.0:1783137704.307897:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:2.0:1783137704.307908:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14488:x1869754974461696:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783137704.307956:0:14268:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783137704.308063:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14488:x1869754974461696:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 157us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137704.308071:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 39 00000100:00100000:2.0:1783137704.318425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137704.319276:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974461824 00000100:00100000:1.0:1783137704.319286:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974461824 00000100:00100000:1.0:1783137704.319346:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:1.0:1783137704.319357:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14488:x1869754974461824:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783137704.319425:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319441:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319454:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319537:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319562:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319570:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319593:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319602:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319608:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783137704.319642:0:15443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783137704.319645:0:15443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783137704.319660:0:15443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319670:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319677:0:15443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319684:0:15443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319690:0:15443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2045000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137704.319694:0:15443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319707:0:15443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319719:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9709860f4300) 00010000:00010000:1.0:1783137704.319722:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137704.319726:0:15443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319733:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045000/0x88def104ac675f4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319745:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319751:0:15443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319757:0:15443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319762:0:15443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2045a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137704.319765:0:15443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319771:0:15443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319777:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff970990e51d00) 00010000:00010000:1.0:1783137704.319780:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137704.319829:0:15443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319845:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045a00/0x88def104ac675f54 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319860:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319866:0:15443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319872:0:15443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319878:0:15443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2045e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137704.319881:0:15443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319887:0:15443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319895:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:1.0:1783137704.319897:0:15443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137704.319901:0:15443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.319906:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709c2045e00/0x88def104ac675f5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137704.320158:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14488:x1869754974461824:12345-192.168.203.36@tcp:34:lhsmtool_posix.0 Request processed in 801us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137704.320168:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 40 00000100:00100000:1.0:1783137704.332127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.332424:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974462080 00000100:00100000:2.0:1783137704.332434:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974462080 00000100:00100000:2.0:1783137704.332598:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:2.0:1783137704.332610:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+24:14488:x1869754974462080:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137704.332630:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137704.332648:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675f62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cd0 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.332742:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.332756:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.332779:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783137704.332828:0:14268:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783137704.334023:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.334036:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.334043:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.334463:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6c00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137704.334523:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.334532:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.334546:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:2.0:1783137704.334549:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783137704.334553:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.334558:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675f69 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.334613:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675f62 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cd0 expref: 26 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.334641:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9709860f4300) 00010000:00010000:2.0:1783137704.334643:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783137704.334647:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675f62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cd0 expref: 26 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.334657:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e6800, rc 0) 00000100:00100000:2.0:1783137704.334729:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+25:14488:x1869754974462080:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 2121us (2611us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1783137704.334737:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 41 00000100:00100000:1.0:1783137704.347595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137704.347669:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974462208 00000100:00100000:3.0:1783137704.347680:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974462208 00000100:00100000:3.0:1783137704.347737:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:3.0:1783137704.347747:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+25:14488:x1869754974462208:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783137704.347780:0:14266:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783137704.347901:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+25:14488:x1869754974462208:12345-192.168.203.36@tcp:53:lhsmtool_posix.0 Request processed in 155us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137704.347910:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 42 00000100:00100000:1.0:1783137704.351430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137704.362926:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974462464 00000100:00100000:0.0:1783137704.362940:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974462464 00000100:00100000:0.0:1783137704.363020:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:0.0:1783137704.363029:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+25:14488:x1869754974462464:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137704.363049:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137704.363067:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675f77 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cd7 expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783137704.368602:0:14267:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1783137704.368616:0:14267:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1783137704.368722:0:14267:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1783137704.369085:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675f7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.369116:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675f7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.369130:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675f7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.369220:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675f77 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cd7 expref: 28 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.369239:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675f7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cd7 expref: 27 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.369248:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9709860f4500) 00010000:00010000:0.0:1783137704.369251:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783137704.369254:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235200, rc 0) 00000100:00100000:0.0:1783137704.369316:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+27:14488:x1869754974462464:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 6287us (17894us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1783137704.369325:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 43 00000100:00100000:1.0:1783137704.381450:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137704.381528:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974462720 00000100:00100000:3.0:1783137704.381537:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974462720 00000100:00100000:3.0:1783137704.381591:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:3.0:1783137704.381601:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+27:14488:x1869754974462720:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783137704.381654:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137704.381680:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675f7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cd7 expref: 27 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381699:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9709860f4500) 00010000:00010000:3.0:1783137704.381709:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783137704.381742:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381755:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381765:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381778:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381784:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381819:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381890:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381897:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381904:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381910:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980030000 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137704.381924:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.381932:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.382072:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9709860f4d00) 00010000:00010000:3.0:1783137704.382075:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137704.382079:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.382085:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff970980030000/0x88def104ac675f8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.382097:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.382103:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.382107:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.382112:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:3.0:1783137704.382115:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.382120:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.382126:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6883994a (ffff970987fc4700) 00010000:00010000:3.0:1783137704.382128:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783137704.382131:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.382136:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff970980031a00/0x88def104ac675f93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6883994a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137704.382267:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+26:14488:x1869754974462720:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 665us (825us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783137704.382274:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 44 00000100:00100000:1.0:1783137704.397342:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.397424:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974462848 00000100:00100000:2.0:1783137704.397433:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974462848 00000100:00100000:2.0:1783137704.397494:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:2.0:1783137704.397504:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+26:14488:x1869754974462848:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137704.397524:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137704.397546:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675f9a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cde expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.397580:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675fa1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.397592:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.397602:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.397695:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675f9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cde expref: 28 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.397721:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6c00/0x88def104ac675fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cde expref: 27 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.397730:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff970983e34f00) 00010000:00010000:2.0:1783137704.397733:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783137704.397736:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e6c00, rc 0) 00000100:00100000:2.0:1783137704.397834:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+27:14488:x1869754974462848:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 331us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137704.397842:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 45 00000100:00100000:1.0:1783137704.402764:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.403098:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974463104 00000100:00100000:2.0:1783137704.403108:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974463104 00000100:00100000:2.0:1783137704.403161:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 46 00000100:00100000:2.0:1783137704.403171:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+27:14488:x1869754974463104:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783137704.403258:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.403276:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.403288:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783137704.403625:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1783137704.403635:0:15443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 460300842651ns, next at 461300840649ns, rc = 0 00000004:00010000:2.0:1783137704.403717:0:15443:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000906989ef reply state 0000000059e72d07 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137704.403750:0:15443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137704.403870:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+29:14488:x1869754974463104:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 699us (1114us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1783137704.403877:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 46 00010000:00010000:2.0:1783137704.406749:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.406765:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.406772:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.406779:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6800 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137704.406783:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.406994:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.407013:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff970983e34f00) 00010000:00010000:2.0:1783137704.407016:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783137704.407021:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.407026:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6800/0x88def104ac675fa8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137704.408215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.408735:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974463232 00000100:00100000:2.0:1783137704.408744:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974463232 00000100:00100000:2.0:1783137704.408882:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:2.0:1783137704.408892:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+28:14488:x1869754974463232:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783137704.408923:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783137704.408948:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72ce5 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.409006:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ce5 expref: 29 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.409018:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ce5 expref: 29 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.409037:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff970983e34f00) 00010000:00010000:2.0:1783137704.409040:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783137704.409043:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709b26e6400, rc 0) 00000100:00100000:2.0:1783137704.409089:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+29:14488:x1869754974463232:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 198us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137704.409095:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 47 00000100:00100000:1.0:1783137704.413209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137704.413312:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974463360 00000100:00100000:3.0:1783137704.413320:0:16264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974463360 00000100:00100000:3.0:1783137704.413373:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:3.0:1783137704.413383:0:16264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2352:x1869754974463360:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783137704.413700:0:16264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:2352:x1869754974463360:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 318us (497us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783137704.413708:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 12 00000100:00100000:1.0:1783137704.420891:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137704.421105:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974463616 00000100:00100000:0.0:1783137704.421114:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974463616 00000100:00100000:0.0:1783137704.421169:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:0.0:1783137704.421178:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+29:14488:x1869754974463616:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783137704.421406:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+30:14488:x1869754974463616:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 228us (522us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1783137704.421415:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 9 00000100:00100000:1.0:1783137704.424410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.424498:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974463872 00000100:00100000:2.0:1783137704.424507:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974463872 00000100:00100000:2.0:1783137704.424563:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:2.0:1783137704.424572:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+30:14488:x1869754974463872:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783137704.424676:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+30:14488:x1869754974463872:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137704.424682:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 48 00000100:00100000:1.0:1783137704.428078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137704.428226:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974464000 00000100:00100000:0.0:1783137704.428235:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974464000 00000100:00100000:0.0:1783137704.428294:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:0.0:1783137704.428305:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+30:14488:x1869754974464000:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137704.428323:0:14267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137704.428342:0:14267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675fb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cec expref: -99 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.428439:0:14267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675fbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.428453:0:14267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675fbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.428474:0:14267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675fbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783137704.428508:0:14267:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783137704.428527:0:14267:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675fbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.428552:0:14267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234200/0x88def104ac675fb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cec expref: 32 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.428571:0:14267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675fbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cec expref: 31 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.428579:0:14267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff970983e34f00) 00010000:00010000:0.0:1783137704.428582:0:14267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783137704.428585:0:14267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235200, rc 0) 00000100:00100000:0.0:1783137704.428642:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+31:14488:x1869754974464000:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 339us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137704.428649:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 49 00000100:00100000:1.0:1783137704.432108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137704.432269:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974464128 00000100:00100000:0.0:1783137704.432277:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974464128 00000100:00100000:0.0:1783137704.432336:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:0.0:1783137704.432358:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+6:2352:x1869754974464128:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783137704.432376:0:14916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783137704.432404:0:14916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xad67a02a7ec72cf3 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783137704.432430:0:14916:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4885a8, blocks: 0x1 00010000:00010000:0.0:1783137704.432450:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1783137704.432455:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137704.433869:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cf3 expref: 7 pid: 14916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.433901:0:14916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cf3 expref: 7 pid: 14916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.434020:0:14916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9709bd235400, rc 0) 00000100:00100000:1.0:1783137704.434158:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:2352:x1869754974464128:12345-192.168.203.36@tcp:101:lhsmtool_posix.0 Request processed in 1799us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137704.434167:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:1.0:1783137704.437617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.437729:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974464384 00000100:00100000:2.0:1783137704.437747:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974464384 00000100:00100000:3.0:1783137704.437901:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:3.0:1783137704.438051:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+31:14488:x1869754974464384:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783137704.438199:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+31:14488:x1869754974464384:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 288us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137704.438208:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 50 00000100:00100000:2.0:1783137704.441491:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137704.441628:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974464512 00000100:00100000:0.0:1783137704.441638:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974464512 00000100:00100000:0.0:1783137704.441692:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:0.0:1783137704.441702:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+31:14488:x1869754974464512:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783137704.485836:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1783137704.485867:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:3.0:1783137704.485895:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1783137704.485925:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1783137704.486039:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990175104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783137704.486052:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+14:14488:x1869754974464512:12345-192.168.203.36@tcp:44:lhsmtool_posix.0 Request processed in 44349us (44568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137704.486062:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 51 00000100:00100000:3.0:1783137704.486089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137704.486165:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990175104 00000100:00100000:3.0:1783137704.486172:0:16264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990175104 00000100:00080000:0.0:1783137704.486218:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783137704.486227:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783137704.486236:0:16264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990175104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783137704.486395:0:16264:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783137704.486400:0:16264:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1783137704.486402:0:16264:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783137704.486405:0:16264:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783137704 -> 1783137704 00002000:00010000:3.0:1783137704.486407:0:16264:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783137704.486452:0:16264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869754990175104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (351us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1783137704.486459:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1783137704.486500:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9709bd089500/2, rc 0, transno 8589934595 00000100:00100000:3.0:1783137704.486506:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990175104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783137704.489397:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.489789:0:14917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974464640 00000100:00100000:2.0:1783137704.489888:0:14917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974464640 00000100:00100000:2.0:1783137704.489949:0:14917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:2.0:1783137704.489959:0:14917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:2351:x1869754974464640:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783137704.490069:0:14917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:2351:x1869754974464640:12345-192.168.203.36@tcp:16:lhsmtool_posix.0 Request processed in 111us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137704.490077:0:14917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 15 00000100:00100000:0.0:1783137704.492587:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.493044:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974464896 00000100:00100000:2.0:1783137704.493053:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974464896 00000100:00100000:2.0:1783137704.493196:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 52 00000100:00100000:2.0:1783137704.493208:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+14:14488:x1869754974464896:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783137704.493359:0:15443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137704.493503:0:15443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235200/0x88def104ac675fbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cec expref: 14 pid: 14267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.493523:0:15443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff970983e34f00) 00010000:00010000:2.0:1783137704.493528:0:15443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783137704.493557:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.493569:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.493577:0:15443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783137704.494412:0:15443:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008dda6713 reply state 00000000c6e6738b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137704.494437:0:15443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783137704.494547:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+15:14488:x1869754974464896:12345-192.168.203.36@tcp:36:lhsmtool_posix.0 Request processed in 1340us (1966us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1783137704.494555:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 52 00010000:00010000:2.0:1783137704.496367:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.496382:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.496390:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.496403:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137704.496408:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.496416:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.496431:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff970983e34f00) 00010000:00010000:2.0:1783137704.496434:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137704.496438:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.496444:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fcb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137704.497350:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137704.497637:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974465024 00000100:00100000:3.0:1783137704.497646:0:16264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974465024 00000100:00100000:3.0:1783137704.497702:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:3.0:1783137704.497713:0:16264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:2351:x1869754974465024:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783137704.498018:0:16264:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783137704.498023:0:16264:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783137702 00002000:00010000:3.0:1783137704.498026:0:16264:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783137702 00002000:00010000:3.0:1783137704.498029:0:16264:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783137704 -> 1783137702 00002000:00010000:3.0:1783137704.498031:0:16264:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783137704.498088:0:16264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+8:2351:x1869754974465024:12345-192.168.203.36@tcp:2:lhsmtool_posix.0 Request processed in 377us (743us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783137704.498104:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 16 00000100:00100000:1.0:1783137704.499999:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.500073:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974465152 00000100:00100000:2.0:1783137704.500081:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974465152 00000100:00100000:2.0:1783137704.500150:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:2.0:1783137704.500160:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+8:2351:x1869754974465152:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783137704.500205:0:14916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.500221:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137704.500225:0:14916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137704.500296:0:14916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.500311:0:14916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.500337:0:14916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.500344:0:14916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.500351:0:14916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.500357:0:14916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7000 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137704.500361:0:14916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.500368:0:14916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.500582:0:14916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.500590:0:14916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079de9146/0x88def104ac675fd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137704.500723:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+8:2351:x1869754974465152:12345-192.168.203.36@tcp:1:lhsmtool_posix.0 Request processed in 564us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137704.500731:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:1.0:1783137704.503699:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.503870:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974465408 00000100:00100000:2.0:1783137704.503880:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974465408 00000100:00100000:2.0:1783137704.503936:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 53 00000100:00100000:2.0:1783137704.503946:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+14:14488:x1869754974465408:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783137704.504020:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.504036:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.504047:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.504659:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.504673:0:14268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ce5 expref: 15 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.504692:0:14268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.504724:0:14268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ce5 expref: 15 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.504737:0:14268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ce5 expref: 15 pid: 14268 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137704.504752:0:14268:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14268:1869754990175232:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137704.505071:0:14268:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709ade25780 going to sleep for 11 seconds 00000100:00100000:2.0:1783137704.508065:0:14268:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd247480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14268:1869754990175232:192.168.203.36@tcp:104: 00010000:00010000:2.0:1783137704.508093:0:14268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137704.508866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.509054:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974465536 00000100:00100000:2.0:1783137704.509062:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974465536 00010000:00010000:2.0:1783137704.509146:0:14252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ce5 expref: 16 pid: 14268 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137704.509195:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 13 00000100:00100000:2.0:1783137704.509206:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709894e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+16:2352:x1869754974465536:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137704.509344:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137704.509353:0:14252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ce5 expref: 16 pid: 14268 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.509502:0:14252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ce5 expref: 16 pid: 14268 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.509526:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675faf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72ce5 expref: 16 pid: 14268 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.509543:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff970983e34f00) 00010000:00010000:2.0:1783137704.509548:0:14252:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.509558:0:14252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.509565:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.509636:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783137704.509680:0:14268:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.509688:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137704.509738:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+15:2352:x1869754974465536:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 533us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137704.509745:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 13 00000001:00080000:1.0:1783137704.509911:0:14268:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1783137704.510485:0:14268:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1783137704.510534:0:14268:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1783137704.510631:0:14268:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709894e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14268:1869754990175360:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783137704.510721:0:14268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137704.510848:0:14271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990175360 00000100:00100000:0.0:1783137704.510859:0:14271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990175360 00000100:00100000:1.0:1783137704.510909:0:14268:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ceb5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783137704.510998:0:14271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783137704.511008:0:14271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14268:x1869754990175360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783137704.511099:0:14271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14268:x1869754990175360:12345-0@lo:1000:mdt00_002.0 Request processed in 92us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137704.511106:0:14271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783137704.511181:0:14268:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709894e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14268:1869754990175360:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1783137704.512705:0:14268:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1783137704.512995:0:14268:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd923100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14268:1869754990175488:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783137704.513050:0:14268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137704.513118:0:14268:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ceb5000 going to sleep for 11 seconds 00000100:00100000:2.0:1783137704.513372:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990175488 00000100:00100000:2.0:1783137704.513379:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990175488 00000100:00100000:2.0:1783137704.513423:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783137704.513431:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14268:x1869754990175488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783137704.513647:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14268:x1869754990175488:12345-0@lo:1000:mdt00_002.0 Request processed in 216us (596us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1783137704.513655:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783137704.513723:0:14268:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd923100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14268:1869754990175488:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1783137704.513908:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.513919:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.513926:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.513933:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7a00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137704.513937:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.513944:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.513960:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff970983e34f00) 00010000:00010000:1.0:1783137704.513963:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137704.513967:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.513984:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7a00/0x88def104ac675fe0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.514026:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.514033:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.514038:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.514043:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234e00 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:1.0:1783137704.514046:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.514051:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.514060:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:1.0:1783137704.514062:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137704.514068:0:14268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675f46 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc9 expref: 18 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.514079:0:14268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675f46 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc9 expref: 18 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.514088:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675f46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc9 expref: 18 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.514197:0:14268:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7c00/0x88def104ac675f46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cc9 expref: 18 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137704.514260:0:14268:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd922a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14268:1869754990175616:192.168.203.36@tcp:105: 00000100:00100000:1.0:1783137704.514432:0:14268:0:(client.c:2701:ptlrpc_set_wait()) set ffff97099ceb5000 going to sleep for 11 seconds 00000100:00100000:2.0:1783137704.519396:0:14268:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd922a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14268:1869754990175616:192.168.203.36@tcp:105: 00010000:00010000:2.0:1783137704.519425:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519435:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd234e00/0x88def104ac675f3f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519466:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519480:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519490:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519501:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519508:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519514:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519519:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137704.519523:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519529:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519540:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:2.0:1783137704.519560:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783137704.519565:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519571:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e6400/0x88def104ac675fe7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519582:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519586:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519591:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519596:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e7400 already unused, calling callback (ffffffffc1f1a4f0) 00010000:00010000:2.0:1783137704.519598:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519603:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519611:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff970983e34100) 00010000:00010000:2.0:1783137704.519613:0:14268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783137704.519615:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.519619:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709b26e7400/0x88def104ac675fd9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137704.519867:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709894e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+18:14488:x1869754974465408:12345-192.168.203.36@tcp:57:lhsmtool_posix.0 Request processed in 15921us (16174us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1783137704.519887:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 53 00000020:00080000:2.0:1783137704.519893:0:14268:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783137704.520058:0:14300:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783137704.520063:0:14300:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137704.520089:0:14300:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783137704.520095:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783137704.520209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137704.520423:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974465664 00000100:00100000:0.0:1783137704.520430:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974465664 00000100:00100000:0.0:1783137704.520477:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:0.0:1783137704.520486:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970989ce0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+18:14487:x1869754974465664:12345-192.168.203.36@tcp:49:dd.0 00000100:00100000:0.0:1783137704.520591:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970989ce0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+18:14487:x1869754974465664:12345-192.168.203.36@tcp:49:dd.0 Request processed in 106us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137704.520598:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 10 00000100:00100000:1.0:1783137704.524583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137704.524668:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974465920 00000100:00100000:0.0:1783137704.524678:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974465920 00000100:00100000:0.0:1783137704.524776:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 11 00000100:00100000:0.0:1783137704.524786:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+18:14488:x1869754974465920:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783137704.525481:0:14269:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783137704.525596:0:14269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1783137704.525635:0:14269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.525650:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.525669:0:14269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.525678:0:14269:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.525683:0:14269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.525689:0:14269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.525700:0:14269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783137704.525775:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+20:14488:x1869754974465920:12345-192.168.203.36@tcp:35:lhsmtool_posix.0 Request processed in 989us (1199us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1783137704.525783:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 11 00000020:00080000:0.0:1783137704.525787:0:14269:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783137704.526415:0:16298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783137704.526422:0:16298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.526441:0:16298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd235e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137704.526445:0:16298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.526454:0:16298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.526466:0:16298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff970983e34f00) 00010000:00010000:3.0:1783137704.526469:0:16298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783137704.526474:0:16298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.526479:0:16298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9709bd235e00/0x88def104ac675fee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.526490:0:16298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137704.526492:0:16298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783137704.526494:0:16298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137704.739044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137704.739083:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137704.739108:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137704.739135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137704.739151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:0.0:1783137704.739249:0:14922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974466048 00000100:00100000:0.0:1783137704.739258:0:14922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974466048 00000100:00100000:0.0:1783137704.739306:0:14922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974466176 00000100:00100000:0.0:1783137704.739309:0:14922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974466176 00000100:00100000:0.0:1783137704.739324:0:14922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974466304 00000100:00100000:0.0:1783137704.739327:0:14922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974466304 00000100:00100000:0.0:1783137704.739338:0:14922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974466432 00000100:00100000:0.0:1783137704.739340:0:14922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974466432 00000100:00100000:0.0:1783137704.739351:0:14922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974466560 00000100:00100000:0.0:1783137704.739353:0:14922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974466560 00000100:00100000:0.0:1783137704.739372:0:14922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:0.0:1783137704.739379:0:14922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+12:2352:x1869754974466048:12345-192.168.203.36@tcp:4:dd.0 00010000:00010000:0.0:1783137704.739412:0:14922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.739444:0:14922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cf3 expref: 12 pid: 14916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.739453:0:14922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137704.739457:0:14922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137704.739462:0:14922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.739497:0:14922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cf3 expref: 12 pid: 14916 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.739511:0:14922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cf3 expref: 12 pid: 14916 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137704.739526:0:14922:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:14922:1869754990175744:192.168.203.36@tcp:104: 00000100:00100000:0.0:1783137704.739612:0:14922:0:(client.c:2701:ptlrpc_set_wait()) set ffff9709897b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783137704.743175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.743277:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:1.0:1783137704.746522:0:14921:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783137704.747677:0:14921:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1783137704.747951:0:14921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974466816 00000100:00100000:3.0:1783137704.747960:0:14921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974466816 00000100:00100000:0.0:1783137704.748564:0:16413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974466688 00000100:00100000:0.0:1783137704.748570:0:16413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974466688 00000100:00100000:1.0:1783137704.749021:0:14920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:1.0:1783137704.749035:0:14920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+14:2352:x1869754974466176:12345-192.168.203.36@tcp:4:dd.0 00010000:00010000:1.0:1783137704.749069:0:14920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.749088:0:14920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137704.749093:0:14920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137704.749109:0:14920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.749120:0:14920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137704.749362:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.749881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:2.0:1783137704.749960:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974467072 00000100:00100000:1.0:1783137704.750082:0:14922:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:14922:1869754990175744:192.168.203.36@tcp:104: 00000100:00100000:2.0:1783137704.750192:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974467072 00010000:00010000:2.0:1783137704.750223:0:14253:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cf3 expref: 15 pid: 14916 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137704.750259:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 14 00000100:00100000:2.0:1783137704.750267:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709b7cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+15:2352:x1869754974467072:12345-192.168.203.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137704.750278:0:14253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137704.750297:0:14253:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cf3 expref: 15 pid: 14916 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.750311:0:14253:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cf3 expref: 15 pid: 14916 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.750331:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f2b6aca/0x88def104ac675fc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.36@tcp remote: 0xad67a02a7ec72cf3 expref: 15 pid: 14916 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.750343:0:14253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137704.750347:0:14253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137704.750362:0:14253:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.750371:0:14253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.750379:0:14253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137704.750382:0:14253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137704.750385:0:14253:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.750392:0:14253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137704.750886:0:14921:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1783137704.750894:0:14921:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1783137704.751042:0:14921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974466944 00000100:00100000:3.0:1783137704.751048:0:14921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974466944 00000100:00100000:3.0:1783137704.751453:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:3.0:1783137704.752104:0:16414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dbff8b30-85ae-47b7-8614-cc3f77566a29+15:2352:x1869754974466304:12345-192.168.203.36@tcp:4:dd.0 00010000:00010000:3.0:1783137704.752140:0:16414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.757884:0:14922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.758492:0:14920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.758503:0:14920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137704.760249:0:14253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137704.760297:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709b7cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+16:2352:x1869754974467072:12345-192.168.203.36@tcp:103:ldlm_bl.0 Request processed in 10024us (10411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137704.760307:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 14 00010000:00010000:3.0:1783137704.760430:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137704.760437:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137704.760445:0:16414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.760471:0:16414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.762498:0:14922:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.762515:0:14922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137704.874262:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1783137704.874282:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1783137704.874364:0:14920:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1783137704.874369:0:14920:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783137702 -> 1783137704 00002000:00010000:1.0:1783137704.874371:0:14920:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783137702 -> 1783137704 00002000:00010000:1.0:1783137704.874374:0:14920:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1783137704.874387:0:14920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.874460:0:14920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.874470:0:14920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.874477:0:14920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2045a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:1.0:1783137704.874481:0:14920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.874490:0:14920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.874524:0:14920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.874532:0:14920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d106b28c/0x88def104ac675ffc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783137704.874618:0:14920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+18:2352:x1869754974466176:12345-192.168.203.36@tcp:4:dd.0 Request processed in 125582us (135530us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1783137704.874627:0:14920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1 00000100:00100000:1.0:1783137704.874652:0:14920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:1.0:1783137704.874662:0:14920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+17:2352:x1869754974466432:12345-192.168.203.36@tcp:4:dd.0 00010000:00010000:1.0:1783137704.874688:0:14920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.874700:0:14920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137704.874704:0:14920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783137704.874709:0:14920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137704.874721:0:14920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783137704.927163:0:16414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1783137704.927191:0:16414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:0.0:1783137704.927206:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.927219:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.927228:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.927236:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:0.0:1783137704.927241:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.927250:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.927267:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.927274:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097bd2b16/0x88def104ac676003 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783137704.927355:0:16414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dbff8b30-85ae-47b7-8614-cc3f77566a29+19:2352:x1869754974466304:12345-192.168.203.36@tcp:4:dd.0 Request processed in 175389us (188242us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783137704.927365:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2 00000100:00100000:0.0:1783137704.927447:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:0.0:1783137704.927466:0:16414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dbff8b30-85ae-47b7-8614-cc3f77566a29+18:2352:x1869754974466560:12345-192.168.203.36@tcp:4:dd.0 00010000:00010000:0.0:1783137704.927494:0:16414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.927506:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137704.927511:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783137704.927517:0:16414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137704.927531:0:16414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137704.931643:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1783137704.931664:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:3.0:1783137704.931725:0:14922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.931737:0:14922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.931745:0:14922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.931751:0:14922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234c00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137704.931756:0:14922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.931770:0:14922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.931788:0:14922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.931816:0:14922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3cb333c/0x88def104ac675ff5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137704.931901:0:14922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+14:2352:x1869754974466048:12345-192.168.203.36@tcp:4:dd.0 Request processed in 192517us (192861us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783137704.931909:0:14922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 0 00000100:00100000:3.0:1783137704.931944:0:14922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5 00000100:00100000:3.0:1783137704.931955:0:14922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+13:2351:x1869754974466816:12345-192.168.203.36@tcp:4:dd.0 00010000:00010000:3.0:1783137704.931982:0:14922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.931994:0:14922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137704.931998:0:14922:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137704.932004:0:14922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.932015:0:14922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783137704.994296:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1783137704.994344:0:14920:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00002000:00010000:3.0:1783137704.994349:0:14920:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1783137704.994363:0:14920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.994377:0:14920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.994385:0:14920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.994402:0:14920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709c2044a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137704.994407:0:14920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.994416:0:14920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.994435:0:14920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.994442:0:14920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fdccd8/0x88def104ac67600a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137704.994681:0:14920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+15:2352:x1869754974466432:12345-192.168.203.36@tcp:4:dd.0 Request processed in 120017us (255539us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1783137704.994702:0:14920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 3 00000100:00100000:3.0:1783137704.994733:0:14920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 6 00000100:00100000:3.0:1783137704.994745:0:14920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+14:2351:x1869754974466688:12345-192.168.203.36@tcp:4:dd.0 00010000:00010000:3.0:1783137704.994774:0:14920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.994786:0:14920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137704.994825:0:14920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783137704.994832:0:14920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137704.994844:0:14920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137705.005710:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783137705.061337:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:2.0:1783137705.061355:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1783137705.061583:0:16414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1783137705.061600:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.061613:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.061622:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.061640:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709bd234e00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137705.061645:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.061653:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.061671:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.061678:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c17e9a6f/0x88def104ac676011 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137705.061759:0:16414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dbff8b30-85ae-47b7-8614-cc3f77566a29+12:2352:x1869754974466560:12345-192.168.203.36@tcp:4:dd.0 Request processed in 134292us (322603us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1783137705.061772:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4 00000100:00100000:2.0:1783137705.061828:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 7 00000100:00100000:2.0:1783137705.061845:0:16414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dbff8b30-85ae-47b7-8614-cc3f77566a29+11:2352:x1869754974466944:12345-192.168.203.36@tcp:4:dd.0 00010000:00010000:2.0:1783137705.061871:0:16414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.061882:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137705.061886:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783137705.061892:0:16414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.061922:0:16414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783137705.062130:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783137705.062361:0:14922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.062371:0:14922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.062379:0:14922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.062385:0:14922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980031800 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137705.062389:0:14922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.068834:0:14922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.068857:0:14922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.068866:0:14922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089e7b57b/0x88def104ac676018 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137705.068993:0:14922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dbff8b30-85ae-47b7-8614-cc3f77566a29+11:2351:x1869754974466816:12345-192.168.203.36@tcp:4:dd.0 Request processed in 137036us (325822us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1783137705.069003:0:14922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5 00002000:00010000:2.0:1783137705.116561:0:14920:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1783137705.116569:0:14920:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1783137705.116585:0:14920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.116599:0:14920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.116608:0:14920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.116615:0:14920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff970980030a00 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:2.0:1783137705.116619:0:14920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.116628:0:14920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.116648:0:14920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137705.116656:0:14920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa96d8a6/0x88def104ac67601f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783137705.116769:0:14920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dbff8b30-85ae-47b7-8614-cc3f77566a29+11:2351:x1869754974466688:12345-192.168.203.36@tcp:4:dd.0 Request processed in 122023us (373486us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783137705.116779:0:14920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 6 00000001:00080000:2.0:1783137705.116839:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1783137705.196815:0:16414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1783137705.196836:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137705.196849:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137705.196858:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137705.196867:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9709b26e6600 already unused, calling callback (ffffffffc14dece0) 00010000:00010000:3.0:1783137705.196872:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137705.196892:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137705.196920:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137705.196929:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000110eaa13/0x88def104ac676026 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783137705.197021:0:16414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dbff8b30-85ae-47b7-8614-cc3f77566a29+7:2352:x1869754974466944:12345-192.168.203.36@tcp:4:dd.0 Request processed in 135181us (447654us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1783137705.197031:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 7 00000001:00080000:2.0:1783137705.197158:0:7535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1783137706.023003:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783137706.866527:0:16452:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1783137706.923131:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783137706.923154:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709b7caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990175872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137706.923231:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137706.923305:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990175872 00000100:00100000:2.0:1783137706.923312:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990175872 00000100:00100000:2.0:1783137706.923365:0:14918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783137706.923375:0:14918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff970986663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990175872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783137706.923409:0:14918:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783137706.923943:0:14918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff970986663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990175872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 567us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137706.923961:0:14918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783137706.923987:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137706.924121:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709b7caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990175872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783137707.047034:0:16298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137707.949506:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990176128:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.949573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137707.949628:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990176640:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.949652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137707.949682:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783137707.949688:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3307:1869754990176000:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.949712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137707.949732:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990176512:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.949753:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137707.949779:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990176256:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.949853:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137707.949873:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783137707.949878:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bc974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990176384:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.949914:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137707.949945:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990176640 00000100:00100000:0.0:1783137707.949951:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990176640 00000100:00100000:0.0:1783137707.949998:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990176512 00000100:00100000:0.0:1783137707.950002:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990176512 00000100:00100000:0.0:1783137707.950016:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990176384 00000100:00100000:0.0:1783137707.950018:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990176384 00000100:00100000:0.0:1783137707.950032:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783137707.950039:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990176640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950091:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869754990176640:12345-0@lo:400:kworker.0 Request processed in 51us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137707.950098:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783137707.950113:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137707.950119:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990176512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950145:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869754990176512:12345-0@lo:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137707.950151:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783137707.950172:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137707.950178:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990176384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950210:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869754990176384:12345-0@lo:400:kworker.0 Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137707.950215:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783137707.950233:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990176128 00000100:00100000:0.0:1783137707.950236:0:16264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990176128 00000100:00100000:0.0:1783137707.950267:0:16264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990176256 00000100:00100000:0.0:1783137707.950270:0:16264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990176256 00000100:00100000:0.0:1783137707.950291:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137707.950298:0:16264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990176128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950331:0:16264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869754990176128:12345-0@lo:400:kworker.0 Request processed in 34us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137707.950337:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783137707.950347:0:16264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783137707.950353:0:16264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990176256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950378:0:16264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869754990176256:12345-0@lo:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137707.950383:0:16264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1783137707.950401:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137707.950404:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137707.950438:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869754990176384:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950448:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1783137707.950452:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9709bd089500, transno 8589934595 00000004:00080000:0.0:1783137707.950463:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1783137707.950480:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1869754990176256:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950511:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1869754990176512:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950520:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1869754990176128:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950529:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1869754990176640:0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950567:0:14261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990176000 00000100:00100000:0.0:1783137707.950570:0:14261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990176000 00000100:00100000:0.0:1783137707.950595:0:14261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783137707.950608:0:14261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3307:x1869754990176000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137707.950642:0:14261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc971450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa5ae7e8-ddd7-40d6-9869-0eebcb903814+19:3307:x1869754990176000:12345-0@lo:400:kworker.0 Request processed in 35us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137707.950647:0:14261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783137707.950682:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bc974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa5ae7e8-ddd7-40d6-9869-0eebcb903814:3307:1869754990176000:0@lo:400:kworker.0 00000100:00100000:1.0:1783137707.958834:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137707.958866:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9709bd08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990176768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137707.958938:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137707.959128:0:14918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754990176768 00000100:00100000:3.0:1783137707.959136:0:14918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754990176768 00000100:00100000:3.0:1783137707.959195:0:14918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137707.959204:0:14918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990176768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137707.959236:0:14918:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1783137707.959277:0:14918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1869754990176768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137707.959284:0:14918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783137707.961244:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9709bd08b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1869754990176768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783137708.075855:0:14255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137708.343320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137708.343367:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137708.343403:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137708.343430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137708.343468:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137708.343486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137708.343527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp) 00000100:00100000:3.0:1783137708.343556:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974467584 00000100:00100000:3.0:1783137708.343565:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974467584 00000100:00100000:3.0:1783137708.343614:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974467840 00000100:00100000:3.0:1783137708.343618:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974467840 00000100:00100000:3.0:1783137708.343630:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974467456 00000100:00100000:3.0:1783137708.343632:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974467456 00000100:00100000:3.0:1783137708.343644:0:14916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974467968 00000100:00100000:3.0:1783137708.343646:0:14916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974467968 00000100:00100000:3.0:1783137708.343663:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:3.0:1783137708.343672:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2353:x1869754974467584:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137708.343741:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2353:x1869754974467584:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 70us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137708.343749:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 17 00000100:00100000:3.0:1783137708.343766:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:3.0:1783137708.343772:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57e4b930-3497-4532-8753-869c6eeffd65+5:2353:x1869754974467840:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137708.343831:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57e4b930-3497-4532-8753-869c6eeffd65+5:2353:x1869754974467840:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 59us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137708.343838:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 18 00000100:00100000:3.0:1783137708.343851:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1783137708.343857:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2353:x1869754974467456:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137708.343881:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dbff8b30-85ae-47b7-8614-cc3f77566a29+5:2353:x1869754974467456:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137708.343887:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 19 00000100:00100000:3.0:1783137708.343918:0:14916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:3.0:1783137708.343924:0:14916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57e4b930-3497-4532-8753-869c6eeffd65+5:2353:x1869754974467968:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137708.343949:0:14916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57e4b930-3497-4532-8753-869c6eeffd65+5:2353:x1869754974467968:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137708.343955:0:14916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 20 00000100:00100000:0.0:1783137708.343958:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974467328 00000100:00100000:0.0:1783137708.343962:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974467328 00000100:00100000:3.0:1783137708.343972:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974467200 00000100:00100000:3.0:1783137708.343974:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974467200 00000100:00100000:0.0:1783137708.343991:0:15443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869754974467712 00000100:00100000:3.0:1783137708.343993:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:0.0:1783137708.343994:0:15443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869754974467712 00000100:00100000:3.0:1783137708.343999:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bc970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+13:2353:x1869754974467200:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:0.0:1783137708.344011:0:15443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:0.0:1783137708.344017:0:15443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+20:2353:x1869754974467328:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137708.344020:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bc970450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e12153bb-60a1-4b82-8c05-faed68451b0d+13:2353:x1869754974467200:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 23us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137708.344026:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 124 00000100:00100000:0.0:1783137708.344046:0:15443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dbff8b30-85ae-47b7-8614-cc3f77566a29+20:2353:x1869754974467328:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 28us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137708.344052:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00100000:0.0:1783137708.344055:0:15443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 28 00000100:00100000:3.0:1783137708.344058:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9709bd08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57e4b930-3497-4532-8753-869c6eeffd65+6:2353:x1869754974467712:12345-192.168.203.36@tcp:400:kworker.0 00000100:00100000:3.0:1783137708.344080:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9709bd08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57e4b930-3497-4532-8753-869c6eeffd65+6:2353:x1869754974467712:12345-192.168.203.36@tcp:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137708.344085:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 29 00000100:00080000:3.0:1783137708.344103:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137708.344108:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783137708.344110:0:14262:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1783137708.654992:0:14300:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783137708.655002:0:14300:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783137708.655034:0:14300:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783137708.655041:0:14300:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 29392 lines, 29392 kept, 0 dropped, 0 bad.